Redirection of acoustic radiation from a display device to enhance user experience
By redirecting the output direction of built-in speakers in display devices using waveguides or sound guide features, the audio playback system achieves a more immersive experience by creating additional audio channels, addressing the limitations of existing systems with display devices and soundbars.
Patent Information
- Application Number
- PCT/US2025/024400
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-09-11
- Filing Date
- 2025-04-11
- Publication Date
- 2025-10-23
AI Technical Summary
Audio playback systems with display devices and soundbars do not provide an immersive listening experience due to the built-in speakers of the display device being unused and outputting audio in similar directions as the soundbar, resulting in a lack of spatially distinct audio channels.
Redirect the output direction of the built-in speakers of the display device to create additional audio channels by using waveguides or adjustable sound guide features, allowing the built-in speakers to output sound in different directions, such as upwards, to enhance the immersive audio experience.
The redirected audio channels, combined with the soundbar, increase the number of distinct audio channels, providing a more immersive audio experience for the user.
Smart Images

Figure 00000031_0000 
Figure 00000032_0000 
Figure 00000033_0000
Abstract
Description
REDIRECTION OF ACOUSTIC RADIATION FROM A DISPLAY DEVICE TO ENHANCE USER EXPERIENCECROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims the benefit of priority from U.S. Provisional Application No. 63 / 633,995, filed on 15 April 2024, U.S. Provisional Application No. 63 / 662,504, filed on 21 June 2024, and European Application No. 24199733.7 filed on 11 September 2024, each of which is incorporated by reference herein in its entirety.TECHNICAL FIELD
[0002] This application relates generally to techniques for redirecting acoustic radiation from a display device and controlling audio output from the display device in a corresponding manner to enhance user experience.SUMMARY
[0003] Various aspects of the present disclosure relate to devices, systems, and methods to redirect acoustic radiation from a display device and control audio output from the display device in a corresponding manner to enhance user experience, for example, by providing acoustic radiation in an additional / different direction when the display device is being used with an auxiliary speaker.
[0004] In one aspect of the present disclosure, there is provided a method of generating audio content. The method may include generating, with an electronic processor, first audio content to be output by a speaker of a display device. The first audio content may be generated based on device data of the display device that indicates that a main axis of radiation of the speaker relative to a display screen of the display device is in a first direction. The method may also include determining, with the electronic processor, a presence of an auxiliary speaker configured to output audio associated with the display device. The method may also include determining, w ith the electronic processor and based on determining the presence of the auxiliary speaker, that the main axis of radiation of the speaker relative to the display screen has been modified to be in a second direction different than the first direction. The method may also include in response to determining that the main axis of radiation of the speaker relative to the display screen has been modified to be in the second direction, modifying the device data of the display device, that indicates the main axis of radiation of the speaker relative to the display screen, to indicate that the main axis of radiation of the speaker relative to the display screen isin the second direction. The method may also include generating, with the electronic processor, second audio content to be output by the speaker. The second audio content may be generated based on the device data of the display device that indicates that the main axis of radiation of the speaker relative to the display screen is in the second direction. The second audio content may be generated differently than the first audio content due to the main axis of radiation of the speaker relative to the display screen being modified from the first direction to the second direction.
[0005] In addition to any combination of features described above, the first direction of the main axis of radiation of the speaker relative to the display screen may be downwards or sideways. In addition to any combination of features described above, generating the first audio content may include generating the first audio content to provide a portion of stereo audio when the auxiliary speaker is not present. In addition to any combination of features described above, the second direction of the main axis of radiation of the speaker relative to the display screen may be upward. In addition to any combination of features described above, generating the second audio content may include generating the second audio content to provide a height sound channel when the auxiliary speaker is present.
[0006] In addition to any combination of features described above, generating the second audio content may include generating the second audio content to provide a first sound channel in an audio system. In addition to any combination of features described above, the method may also include generating, with the electronic processor, third audio content to be output by the auxiliary speaker to provide a second sound channel in the audio system. The auxiliary speaker may include a second speaker with a second main axis of radiation relative to the display screen that is different than the main axis of radiation of the speaker of the display device.
[0007] In addition to any combination of features described above, the method may also include receiving, with the electronic processor, a user input via a user input device. In addition to any combination of features described above, determining the presence of the auxiliary' speaker may be based on the user input. In addition to any combination of features described above, determining that the main axis of radiation of the speaker relative to the display screen has been modified to be in the second direction different than the first direction may be based on the user input. In addition to any combination of features described above, modifying the device data of the display device, that indicates the main axis of radiation of the speaker relative to the display screen, to indicate that the main axis of radiation of the speaker relative to the display screen is in the second direction may be based on the user input.
[0008] In addition to any combination of features described above, the second direction may be defined at least partially by at least one of a group consisting of a waveguide coupled to the display device, an adjustable sound guide feature on the display device, a sound guide feature on the auxiliary speaker, a rear surface of the display device, a surface behind the display device that faces the rear surface of the display device, and combinations thereof.
[0009] In addition to any combination of features described above, the first direction and the second direction may be different from each other by at least thirty degrees.
[0010] In addition to any combination of features described above, determining that the main axis of radiation of the speaker relative to the display screen has been modified to be in the second direction may include determining, with the electronic processor, the second direction based on information received from the auxiliary speaker, a detected position of a manually moveable sound guide feature of a housing of the display device, or both the information received from the auxiliary speaker and the detected position of the manually moveable sound guide feature of the housing of the display device.
[0011] In addition to any combination of features described above, the method may also include determining, with the electronic processor, the second direction based on information received from the auxiliary speaker, based on a type of the second audio content, or based on both the information received from the auxiliary speaker and the type of the second audio content. In addition to any combination of features described above, the method may also include in response to determining the second direction, at least one of (i) controlling an actuator to move a sound guide feature of a housing of the display device, and (ii) providing a notification to a user via the display device, where the notification may instruct the user to move a manually moveable sound guide feature of the housing of the display device.
[0012] In addition to any combination of features described above, the method may also include coupling a waveguide to the display device. The waveguide may be configured to capture sound emitted by the speaker in the first direction and redirect the sound such that the main axis of radiation of the sound relative to the display screen is in the second direction.
[0013] In addition to any combination of features described above, the speaker may include a first speaker and a second speaker, and the second direction of the main axis of radiation for both the first speaker and the second speaker may be the same. In addition to any combination of features described above, the second direction of the main axis of radiation of the speaker relative to the display screen may be upward. In addition to any combination of features described above, generating the second audio content may include generating the second audiocontent to provide a distinct height sound channel using each of the first speaker and the second speaker or a dedicated height center sound channel using a combination of the first speaker and the second speaker.
[0014] In addition to any combination of features described above, the electronic processor may include at least one of the group consisting of one or more electronic processors of the display device, one or more electronic processors of an audio receiver, one or more electronic processors of the auxiliary speaker, or combinations thereof. In addition to any combination of features described above, the audio receiver may be communicatively coupled to the display device, the auxiliary speaker, or both the display device and the auxiliary' speaker. In addition to any combination of features described above, the auxiliary speaker may be communicatively coupled to the display device, the audio receiver, or both the display device and the audio receiver.
[0015] In another aspect of the present disclosure, there is provided an audio playback system that may include the electronic processor, and a memory storing instructions, which when executed by the electronic processor, cause the audio playback system to perform the method and / or any combination of features described above.
[0016] In another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing instructions which, when executed by a computing apparatus, cause the computing apparatus to perform the method and / or any combination of features described above.
[0017] Other aspects of the embodiments will become apparent by consideration of the detailed description and accompanying drawings.BRIEF DESCRIPTION OF THE DRAWINGS
[0018] FIG. 1 illustrates a listening environment of an audio playback system without an auxiliary speaker such as a soundbar according to some example embodiments;
[0019] FIG. 2 illustrates a listening environment of an audio playback system with an auxiliary speaker (e.g., a soundbar) according to some example embodiments;
[0020] FIGS. 3A-3D illustrate schematic diagrams of audio playback systems that include the auxiliary speaker and the display device of FIG. 2, where the display device includes sound redirecting features for built-in speakers of the display device according to some example embodiments;
[0021] FIGS. 4A-4C illustrate an example waveguide that acts as a sound redirecting feature of the display device according to some example embodiments;
[0022] FIG. 5 illustrates a listening environment of an audio playback system with an auxiliary speaker (e.g., a soundbar) and with redirecting features implemented on the display device according to some example embodiments;
[0023] FIG. 6 illustrates a block diagram of the devices included in an audio playback system according to some example embodiments;
[0024] FIG. 7 is a hardware block diagram of the display device of the audio playback system of FIG. 6 according to some example embodiments;
[0025] FIG. 8 is a hardware block diagram of the auxiliary' speaker of the audio playback system of FIG. 6 according to some example embodiments;
[0026] FIG. 9 is a hardware block diagram of the audio receiver of the audio playback system of FIG. 6 according to some example embodiments;
[0027] FIG. 10 illustrates a flowchart of a method of generating audio content according to some example embodiments;
[0028] FIG. 11A illustrates an example auxiliary speaker of FIGS. 5. 6, and 8 including built-in sound guide features according to some example embodiments; and
[0029] FIG. 11B illustrates another example auxiliary speaker of FIGS. 5, 6, and 8 including built-in sound guide features according to some example embodiments.DETAILED DESCRIPTION
[0030] Display devices (e.g., televisions, computer monitors, other displays, etc.) in an audio playback system include built-in speakers within a housing of the display device. For example, many display devices include speakers at a bottom of the housing that provide sound output with a main axis of radiation downwards. As another example, some display devices include two speakers near the bottom of the housing that provide sound output with main axes of radiation sideways in an opposite direction from each other (i.e., sound output to the left and right of the display device from each of the two speakers). In some instances, the built-in speakers of the display device may only provide stereo reproduction. For example, each of two built-in speakers may provide a portion of stereo audio output by the display device.
[0031] Many users of display devices also use a separate auxiliary' speaker (e.g., a soundbar) to provide enhanced audio rather than relying on the stereo audio output of the display device.For example, atypical soundbar includes speakers (e.g., three speakers) that provide front left, center, and right sound channels. In most cases however, because the soundbar sits directly under or in front of the display device, it occludes the built-in sound system of the display device. In other words, because the built-in speakers of the display device and the speakers of the soundbar provide audio in a similar direction (e.g., a similar main axis of radiation relative to the display device) and from a similar location, outputting audio from both the built-in speakers of the display device and the speakers of the soundbar does not provide sound from spatially distinct audio channels. Therefore, outputting audio from both the built-in speakers of the display device and the speakers of the soundbar does not provide a more immersive listening experience than using just the speakers from the soundbar. Thus, the display device may disable its built-in speakers when a soundbar is being used.
[0032] Immersive audio reproduction systems benefit from having a plurality’ of spatially distinct audio channels radiating in various directions in a listening environment, especially channels that radiate sound upwards towards a ceiling because a ceiling bounce will enhance the immersive listening experience of a user / listener by providing sound cues coming from above the listener. Accordingly, there is a technological problem with audio playback systems that include a display device and a soundbar in that the built-in speakers of the display device are unused and that the overall system does not provide an immersive audio experience.
[0033] To address the above-noted technological problems, for audio playback systems where a display device and a soundbar are provided (e.g.. systems where only the display device and the soundbar are provided for audio output), the output direction of the built-in speakers of the display device may be adjusted / redirected to increase the potential number of distinct audio channels in the audio playback system. Thus, some distinct audio channels in the audio playback system may be handled through the soundbar whereas other distinct audio channels may be reproduced through the built-in speakers of the display device using redirecting devices. Accordingly, the overall system includes an increased number of total independent sound channels that provide a more immersive audio experience for the user.
[0034] FIG. 1 illustrates a listening environment 100 of an audio playback system without an auxiliary speaker such as a soundbar according to some example embodiments. As shown in FIG. 1, a listening environment 100 (e.g., a room in a house of a user / listener 105) may include a ceiling 110 and a wall 115. A display device 120 (e.g., a television, a computer monitor, or the like) may be mounted to the wall 115 as shown in FIG. 1. Alternatively, the display device 120 may be located on a stand, entertainment center 135, desk, etc. In some instances, a rear surfaceof the display device 120 faces the wall 115 and is located in proximity to the wall 115. For example, a distance between the wall 115 and the rear surface of the display device 120 may be any distance between approximately two centimeters and approximately fifty centimeters.
[0035] As indicated previously herein, the display device 120 may include built-in speakers (e.g., two speakers located near a bottom of a housing of the display device 120). In some instances, the built-in speakers may output sound (i.e., audio content) along a main axis of radiation 125 A, 125B that extends sideways (i.e., left and right) from the display device 120. Additionally or alternatively, the built-in speakers may output sound / audio content along a main axis of radiation 130 that extends downwards from the display device 120. In some instances, the sound output by the built-in speakers may reflect / bounce off of objects (e.g., an entertainment center 135) and / or walls to reach the user 105. Although both main axes of radiation 125 A, 125B and 130 are shown in FIG. 1, in most instances, the display device 120 is configured to include built-in speakers that output sound via a single set of main axes of radiation 125 A, 125B (i.e., sideways) or 130 (i.e., downward). However, in some instances, the display device 120 may include two sets of built-in speakers, one of which outputs sound along a main axis of radiation 125 A, 125B that extends sideways (i.e., left and right) from the display device 120 and the other of which outputs sound along a main axis of radiation 130 that extends downwards from the display device 120.
[0036] In some instances, the audio playback system includes the display device 120 and an audio receiver 140 (i.e., managing device). The audio receiver 140 may be communicatively coupled to the display device 120 and may optionally communicatively couple to other speakers and / or devices in the listening environment 100. In some instances, the audio receiver 140 may be communicatively coupled to the display device 120 via a wired connection and / or via a wireless connection. The audio receiver 140 is optional and may not be included in some audio playback systems.
[0037] FIG. 2 illustrates a listening environment 100 of an audio playback sy stem with an auxiliary speaker 205 (e.g., a soundbar 205) according to some example embodiments. As shown in FIG. 2. the listening environment 100 is the same as the listening environment 100 shown in FIG. 1. However, in FIG. 2, the audio playback system includes an auxiliary speaker 205 (e.g., soundbar 205) in addition to the display device 120 and the optional audio receiver 140. As shown in FIG. 2, the auxiliary' speaker 205 may be located on a top surface of the entertainment center 135. Alternatively, the auxiliary speaker 205 may be mounted to a bottom surface of the housing of the display device 120. The auxiliary speaker 205 may includespeakers (e.g., three speakers) that provide front left, center, and right sound channels. As shown in FIG. 2, the speakers of the auxiliary speaker 205 may output sound / audio content along a main axis of radiation 210 that extends perpendicularly outward / away from a display screen on a front surface of the display device 120.
[0038] As indicated previously herein and as shown in FIG. 2, because the built-in speakers of the display device 120 and the speakers of the auxiliary speaker 205 provide audio in a similar direction toward the user 105 and are located in a similar location, the built-in speakers of the display device 120 may be disabled when the auxiliary speaker 205 is being used. For example, the audio receiver 140 may be communicatively coupled to both the display device 120 and the auxiliary speaker 205 via wired and / or wireless connections. In response to determining that the auxiliary speaker 205 is connected to the audio playback system, the audio receiver 140 may instruct the display device 120 to disable its built-in speakers and provide audio content to the auxiliary speaker 205 via the audio receiver 140. Alternatively, for audio playback systems that do not include the audio receiver 140, the display device 120 and the auxiliary speaker 205 may be communicatively coupled with each other (e.g., via a wired and / or wireless connection) to control sound output from each device.
[0039] Also as indicated previously herein, adjusting / redirecting the output direction of the built-in speakers of the display device and using the previously unused built-in speakers of the display device 120 to output sound / audio content when the auxiliary speaker 205 is present increases the potential number of distinct audio channels in the audio playback system. FIGS. 3A and 3B illustrate schematic diagrams of an audio playback system that includes the auxiliary speaker 205 and the display device 120 with sound redirecting features 305, 310 for the built-in speakers of the display device 120. As shown in FIGS. 3A and 3B, the sound redirecting features 305, 310 adjust / redirect a main axis of radiation of the built-in speakers of the display device 120 from a first direction (e.g.. downward in FIG. 3A or sideways in FIG. 3B) to a second direction 315, 320 (e.g., upward).
[0040] As indicated in FIGS. 3A and 3B, the audio playback system with redirected main axes of radiation 315, 320 for the built-in speakers of the display device 120 includes an increased number of total independent sound channels that provide a more immersive audio experience for the user compared to disabling the built-in speakers or not redirecting the built-in speakers when the auxiliary speaker 205 is present. For example, FIGS. 3A and 3B show a front left audio channel, a front center audio channel, and a front right audio channel respectively provided by the speakers of the auxiliary speaker 205. Additionally, the redirected sound fromthe built-in speakers of the display device 120 provide a height left audio channel and a height right audio channel. In some instances, the height left audio channel and the height right audio channel may be combined to be a dedicated height center audio channel.
[0041] FIGS. 3C and 3D provide additional examples of audio playback systems with one or more redirected main axes of radiation. FIG. 3C is similar to FIG. 3 A (e.g., illustrating the same display device 120 with built-in speakers that are downward firing). However, in FIG. 3C, sound redirecting features 325 A, 325B adjust / redirect a main axis of radiation of the built-in speakers of the display device 120 from a first direction (e.g.. downward in FIG. 3C) to a second direction 330A, 330B (e.g., sideways) rather than upward as shown in FIG. 3A. FIG. 3C shows the redirected axes of radiation 330A, 330B for the built-in speakers of the display device 120 as providing a side left audio channel and side right audio channel instead of the height audio channels provided by the redirected axes of radiation 315 shown in FIG. 3 A. FIG. 3D shows a display device 120 with two sets of built-in speakers including a downward firing set of built-in speakers at a bottom of display device 120 and a sideways firing set of built-in speakers approximately halfway between the bottom of the display device 120 and a top of the display device 120. In some instances, one or both sets of built-in speakers may have their main axes redirected as indicated in FIG. 3D. For example, sound redirecting features 335A, 335B adjust / redirect a main axis of radiation of the sideways firing built-in speakers of the display device 120 from a first direction (e.g., sideways in FIG. 3D) to a second direction 340A, 340B (e.g., upward). Additionally, sound redirecting features 345 A, 345B adjust / redirect a main axis of radiation of the downward firing built-in speakers of the display device 120 from a first direction (e.g., downward in FIG. 3D) to a third direction 350A, 350B (e.g., sideways), which may correspond to the first direction. FIG. 3D shows the redirected axes of radiation 340A, 340B and 350A, 350B for each set of the built-in speakers of the display device 120 as providing a height left audio channel, a height right audio channel, a side left audio channel, and side right audio channel in addition to the three forw ard facing audio channels provided by the auxiliary speaker 205.
[0042] As indicated by the examples provided in FIGS. 3A-3D, a first direction of a main axis of radiation of a built-in speaker of the display device 120 may be in any one of a number of different directions. Additionally, a second direction of a redirected axis of radiation of a built- in speaker of the display device 120 may be in any one of a number of different directions that are different than the first direction. Such different directions may be selectable by a user or otherwise set (e.g.. based on a type of auxiliary speaker 205 coupled to the display device 120. based on a type of waveguide attached to the display device 120, based on which actuators of thedisplay device 120 are actuated to guide sound, etc.) as described herein. Furthermore, the second direction may be different for different built-in speakers (or different set of built-in speakers) on the same display device 120 as shown in FIG. 3D.
[0043] FIGS. 4A-4C illustrate an example waveguide 400 that acts as a sound redirecting feature 305, 310 of the display device 120 according to some example embodiments. FIG. 4A illustrates a front perspective view7of the waveguide 400. FIG. 4B illustrates a side perspective view of the w aveguide 400 along with a plane 425 that represents a rear surface of the display device 120 and a plane 455 along a top surface of the waveguide 400. FIG. 4C illustrates a rear profile view of the waveguide 400.
[0044] As shown in FIGS. 4A and 4B, the w aveguide 400 may include a hom portion 405 and an interfacing portion 410. The example waveguide 400 shown in FIGS. 4A-4C is intended to interface with downward firing built-in speakers of the display device 120 on a bottom of the housing of the display device 120. Accordingly, the interfacing portion 410 faces upward (e.g., toward the downward firing built-in speaker) and includes an interfacing plate 415 with a throat 420 to receive sound from the built-in speakers of the display device 120. As shown in FIG. 4A, the throat 420 may face upwards to receive sound from the built-in speakers that is output downwardly. The size and geometry of the throat 420 may be varied in different embodiments, (e.g., to avoid narrow-band cancellation in acoustic output from the waveguide 400). The interfacing portion 410 is designed to intersect with the hom portion 405 to make an approximately ninety’ -degree angle between the interfacing portion 410 and the hom portion 405. In other words, the w aveguide 400 may fold around a bottom surface of the display device 120 and accommodate a depth sectional profile of the housing of the display device 120. For example, FIG. 4B illustrates a plane 425 that represents a rear surface of the display device 120.
[0045] In other instances, the interfacing plate 415 may face in a different direction and / or the interfacing portion 410 and the hom portion 405 may be oriented differently with respect to each other. For example, the design and configuration of the waveguide 400 may change depending on an orientation of the built-in speakers of the display device 120.
[0046] As shown in FIGS. 4A-4C, from the throat 420 that receives sound from a built-in speaker of the display device 120, there is a folding and expanding pathw ay to the waveguide outlet 430. The folding pathway is defined by the throat 420, the interfacing portion 410, and the bottom portion of the hom portion 405. The expanding pathway is defined by the hom portion 405. As shown in FIGS. 4A-4C, the expanding pathway of the waveguide 400 (i.e., theflare of the waveguide 400) may only be realized to one side and may be an arc 435 (e.g., a circular arc). For example, a front facing side 440 of the hom portion 405 that faces a rear side of the display device 120 may be approximately parallel to the rear side of the display device 120. A first side 445 of the hom portion 405 may be approximately perpendicular to the front facing side 440 and may be flat and extend approximately vertically as shown in FIG. 4A. On the other hand, a second side of the hom portion 405 that is opposite to the first side 445 may include an arc-shaped surface 450 defined by the arc 435 as shown in FIGS. 4A and 4B. In some instances, a rear side 460 of the hom portion 405 may extend upward from interfacing portion 410 at an angle such that a depth of the hom portion 405 is narrower near the interfacing portion 410 and wider at the outlet 430 as shown in FIGS. 4A and 4B.
[0047] In some instances, a shape of the arc 435 is governed by a length 465 of the hom portion 405 of the waveguide 400 and / or a difference in inlet width (e.g., defined by the throat 420 or the intersection of the hom portion 405 and the interfacing portion 410) and outlet width (e g., defined by the outlet 430). For example, the shape of the arc 435 may be designed to create asymmetrical radiation across a long axis of the waveguide 400 to minimize sound leaking around the sides of the display device 120 with the aim of producing tw o distinctly handled height audio channels. In some instances, a frequency range targeted for the waveguide 400 is 500Hz to 20kHz. The length 465 is a determining factor for a cut-on frequency of the w aveguide 400. The variation in the flare of the waveguide 400 is controlled by the radiused sidew all 450 and a linear expansion in overall depth from the throat 420 to the outlet / mouth 430. In some instances, the number of resonances in the waveguide 400 increases as the length 465 increases, but also the “cut-on” frequency that governs the low frequency extension of the waveguide 400 is lowered as the length 465 is increased. In instances without an interfacing plate 415, an anomaly at about 10kHz (e.g., a sharp dip in the frequency response) may be caused by a cancellation at the intersection of the hom portion 405 and the interfacing portion 410. To reduce the affects of this anomaly, the interfacing plate 415 may be included to enable experimentation of the throat geometry to improve the conditions that cause the narrow-band cancellation in acoustic output. For example, varying the throat geometry of the throat 420 affects the frequency of the cancellation. In some instances, numerous interfacing plates 415 with different throat geometries may be interchangeable (e.g., removably attached) to the interfacing portion 410 to provide different acoustic affects as desired.
[0048] In some instances, the waveguide 400 may include mounting tabs 470A, 470B that are configured to allow the waveguide 400 to be fastened / secured / mounted to a housing of the display device 120. For example, the mounting tab 470A protrudes from the hom portion 405and is configured to receive a fastener to secure the horn portion 405 to the rear side of the display device 120. The mounting tabs 470B protrude from the interfacing portion 410 and are each configured to receive a fastener to secure the interfacing portion 410 to the bottom side of the display device 120. In some instances, the waveguide 400 is mounted to the display device 120 along with a second waveguide that has a mirrored design and that is mounted symmetrically about a midline of the display device 120 around two respective built-in speakers of the display device 120. For example, two waveguides 400 may be mounted to the rear side of the display device 120 such that each waveguide 400 has its arc-shaped surface 450 facing away from each other toward a side of the display device 120. Accordingly, sound / audio content output by the built-in speakers of the display device 120 is not output directly from the built-in speakers downw ards or sideways. Rather, the sound / audio content output by the built-in speakers is output as height channel audio content that is heard as sound diffracted over the top edge of the display device 120 and / or that which is reflected from the ceiling 110 of the listening environment 100. In other words, the built-in speakers may output sound / audio content through the waveguide 400 such that the sound / audio content output by the built-in speakers has a main axis of radiation 505 that extends upwards from the display device 120 as shown in FIG. 5. Also as shown in FIG. 5, the height channels provided by the built-in speakers of the display device 120 may be utilized in combination with the forward-facing channels of the auxiliary speaker 205.
[0049] The w aveguide 400 shown in FIGS. 4A-4C is merely an example and may vary in shape, size, orientation, cross-section, expansion, length, depth, etc. in other embodiments to optimize certain aspects of acoustical radiation using, for example, numerical simulation. For example, the w aveguide 400 may include different or additional bends depending on the location of the built-in speakers of the display device 120 and the desired modified direction of the main axis of radiation of the sound output from the built-in speakers relative to the display screen of the display device 120. As another example, dimensions of the arc 435 may van’ to maintain desired frequency response depending on the length 465 or bends required to output sound at a desired location and in a desired direction. As another example, the waveguide 400 may include additional, fewer, and / or different mounting tabs or manners in which to mount the w aveguide 400 to the display device 120.
[0050] While FIGS. 4A-4C show the waveguide 400 that is removably couplable to the display device 120, in other instances, other objects, features, etc. (i.e., other sound redirecting features) may be additionally or alternatively used to modify a main axis of radiation of the built-in speakers of the display device 120 relative to the display screen of the display device120 from a first direction 125A, 125B, 130 (see FIG. 1) to a second direction 505 (see FIG. 5) different than the first direction.
[0051] In some instances, the housing of the display device 120 may include one or more adjustable sound guide features that may be moved to block sound or guide or reflect sound in a certain direction. An adjustable sound guide feature may include a flap or manifold that may be manually moved between (i) an undeployed position where the flap or manifold does not intentionally guide sound from the built-in speakers of the display device 120 and (ii) a deployed position where the flap or manifold guides sound from the built-in speakers of the display device 120. For example, the adjustable sound guide feature may be a flap or manifold mounted on a hinge that allows the flap or manifold to be moved between (i) the undeployed position where the flap or manifold remains flush with the housing of the display device 120 and (ii) the deployed position where the flap or manifold protrudes outward from the housing of the display device 120 to block sound or guide or reflect sound in a certain direction. As a more specific example, flaps or manifolds may surround the built-in speakers in the deployed position to reduce the amount of sound being emitted in the first direction 125A, 125B, 130. Flaps or manifolds may also create a boundary / channel on the rear side / surface of the housing of the display device 120 to direct the sound emitted from the built-in speakers upward over the top edge of the display device 120. In some instances, the combination of the rear surface of the display device 120, the nearby wall 115 (e.g., a surface behind the display device 120 that faces the rear surface of the display device 120), and optional flaps or manifolds on the display device 120 direct sound emitted by the built-in speakers of the display device 120 upward to be emitted in the direction 505 shown in FIG. 5.
[0052] In some instances, the display device 120 may include a sensor configured to determine a position (e.g., undeployed or deployed or deployed in a certain manner) of each manually adjustable flap or manifold. In some instances, one or more of the flaps or manifolds are automatically deployable by the display device 120. For example, each flap or manifold may be coupled to an actuator, such as a servo motor, that may be controlled by the display device 120 to control the position of each flap or manifold. In some instances, the display device 120 may include a sensor configured to determine whether the waveguide(s) 400 and / or the auxiliaryspeaker 205 is mounted to the housing of the display device 120. For example, the sensors may include a magnetic sensor configured to detect a magnetic fastener or a magnetic portion of the waveguide 400 and / or of each adjustable flap or manifold. As another example, the sensors may include an ambient light sensor that may be occluded from light when the waveguide 400 ismounted to the display device 120 or when each adjustable flap or manifold is in a certain position.
[0053] In some instances, the auxiliary speaker 205 may be mounted to a bottom of the display device 120 or may be located close to the bottom of the display device 120, and may include a sound guide feature (e.g., an integrated waveguide(s), moveable sound guide features, etc.) configured to block sound from the built-in speakers of the display device 120 or guide or reflect the sound in a certain direction (e.g., redirect the sound from the display device 120). In some instances, the sound guide feature(s) of the auxiliary’ speaker 205 may be similar to that of the display device 120 described above.
[0054] FIGS. 11A and 1 IB illustrate two different example auxiliary speakers 205 with built-in sound guide features according to some example embodiments. In some instances, the auxiliary speaker 205 is mounted flush to the display device 120 such that there is no distance between the display device 120 and the auxiliary speaker 205 (e.g., to create a closed / sealed path for sound to travel from the speakers of the display device 120 to the sound guide features 1105, 1125 of the auxiliary speaker 205). In some instances, the auxiliary’ speaker 205 is mounted to the display device 120 such that there is a small distance between the display device 120 and the auxiliary speaker 205 (e.g., less than approximately one millimeter, two millimeters, five millimeters, or the like). In some instances in which there is a small distance between the display device 120 and the auxiliary speaker 205, a strip seal (e g., an externally added strip seal, an adjustable or deployable strip seal built-in to the display device 120. etc.) and / or the like may be used to close / seal the small distance between the display device 120 and the auxiliary speaker 205 to improve sound travel from the speakers of the display device 120 to the sound guide features 1105, 1125 of the auxiliary speaker 205.
[0055] As shown in the example of FIG. HA, the auxiliary speaker 205 may include sound guide features 1105 to redirect sound from down firing speakers of the display device 120 to become front left and front right sound channel outputs 1115. The sound guide features 1105 may include (i) a sound input area 1110 configured to capture sound from the down firing speakers of the display device 120 and (ii) a sound output area 1115 to output the sound along a different main axis of radiation (e.g., forw ard in FIG. 11 A) compared to the main axis of radiation (e.g., downw ard in FIG. 11 A) of which the sound was received from the display device 120 (e.g.. a 90-degree redirection of sound from the display device 120 in FIG. 11A). Additionally, the auxiliary speaker 205 includes up firing height speakers 1120 to create a 2.0.2 channel system.
[0056] As shown in the example of FIG. 1 IB. the auxiliary speaker 205 may include sound guide features 1125 to redirect sound from down firing speakers of the display device 120 to become height left and height right sound channel outputs 1135. The sound guide features 1125 may include (i) a sound input area 1130 configured to capture sound from the down firing speakers of the display device 120 and (ii) a sound output area 1135 to output the sound along a different main axis of radiation (e.g., upward and forward in FIG. 1 IB) compared to the main axis of radiation (e.g., downward in FIG. 1 IB) of which the sound was received from the display device 120 (e.g., a 145-degree redirection of sound from the display device 120 in FIG. 1 IB). Additionally, the auxiliary speaker 205 includes left, right, and center channel speakers 1140 to create a 3.0.2 channel system. In some instances, the center channel speaker 1140 may not be present, which would result in a 2.0.2 channel system. In some instances, the sound guide features 1125 and the sound output areas 1135 are designed to output sound upward and forward such that the auxiliary speaker 205 of FIG. 1 IB is located at the bottom of the display device 120 with the sound output areas 1135 in front of the display screen 725 of the display device 120. In other instances, the sound guide features 1125 and the sound output areas 1135 are designed to output sound upward and rearward such that the auxiliary' speaker 205 of FIG. 1 IB is located at the bottom of the display device 120 with the sound output areas 1135 behind the display screen 725 of the display device 120 (e.g.. sound may reflect off of a wall behind the display device 120 as explained herein).
[0057] The auxiliary speakers 205 shown in FIGS. 11 A and 1 IB are merely examples. Other variations and / or combinations of sound guide features and built-in speakers on the auxiliary speaker 205 may be present in other instances. For example, some display devices 120 include a down firing tweeter dedicated to center channel output in addition to down firing left and right channel outputs. For use w ith such a display device 120, the auxiliary' speaker 205 may include (i) a center sound guide feature for redirecting sound from the center-channel down firing tweeter in the display device 120 ninety degrees to create a forward-firing center channel (e.g., similar to the sound guide features 1105 of FIG. 11A); (2) left and right sound guide features for redirecting sound from the dow n firing left and right channel outputs of the display device 120 approximately 145 degrees to create the left height and right height channels (e.g., similar to the sound guide features 1125 of FIG. 1 IB); and (3) integrated / built-in left and right forward facing speakers / drivers to create the left and right channel output, (e.g., similar to built- in speakers 1140 of FIG. 1 IB). Other variations and combinations are also possible to redirect sound to impact / change the configuration of the sound system when the auxiliary device 205 is present.
[0058] In some instances, the housing of the auxiliary speaker 205 may include one or more adjustable sound guide features that may be moved to block sound or guide or reflect sound in a certain direction in a similar manner as described herein with respect to the display device 120. Accordingly, the same auxiliary speaker 205 may be usable with multiple different ty pes of display devices 120 by adjusting certain components to enable / open or disable / close certain sound guide paths formed by adjustable sound guide features of the auxiliary speaker 205. The description of adjustable sound guide features with respect to the display device 120 and any related features / description that is included herein similarly applies to adjustable sound guide features that may be included on the auxiliary speaker 205.
[0059] In some instances, the second direction 505 of the main axis of radiation of the built- in speakers of the display device 120 relative to the display screen of the display device 120 is defined at least partially by at least one of a group consisting of a waveguide 400 coupled to the display device 120, an adjustable sound guide feature on the display device 120, a sound guide feature on the auxiliary speaker 205, a rear surface of the display device 120, a surface behind the display device 120 that faces the rear surface of the display device 120, and combinations thereof. In some instances, the second direction 505 of the main axis of radiation of the built-in speakers of the display device 120 relative to the display screen of the display device 120 is additionally or alternatively defined by acoustic interaction of sound output by a built-in speaker with sound output by one or more other speakers in the audio playback system (e.g., another built-in speaker of the display device 120, the auxiliary speaker 205 such as a sound bar, a different speaker, etc.).
[0060] FIG. 6 illustrates a block diagram of the devices included in an audio playback system 600 according to some example embodiments. For example, the audio playback system 600 may be representative of the audio playback system shown in FIGS. 2 and 5. As shown in FIG. 6. the audio playback system 600 may include the display device 120 and the auxiliary speaker 205. The audio playback system 600 may optionally include the audio receiver 140 (i.e., managing device). As indicated in FIG. 6, each of the devices 120, 205, and 140 may be configured to bidirectionally communicate with each other. Such communication may occur via a wired and / or a wireless connection. Such communication may include control data and / or instructions sent from one device to another device. Such communication additionally or alternatively may include audio data that is configured to be output as sound / audio content by one or more devices. In some embodiments, the audio playback system 600 includes fewer or additional components in configurations different from that illustrated in FIG. 6. For example,the audio playback system 600 may include one or more additional auxiliary speakers in some instances.
[0061] FIG. 7 is a hardware block diagram of the display device 120 according to some example embodiments. In the example illustrated, the display device 120 includes a first electronic processor 705 (for example, a microprocessor or other electronic device). The first electronic processor 705 includes input and output interfaces (not shown) and is electrically coupled to a first memory 710, a first network interface 715, a speaker 720, and a display screen 725. In some embodiments, the display device 120 includes fewer or additional components in configurations different from that illustrated in FIG. 7. For example, the display device 120 may include one or more user input devices such as one or more buttons or joysticks on the housing or may include a remote control device. As another example, the display device 120 may include one or more sensors and / or one or more actuators associated with moveable flaps or manifolds as explained previously herein. As yet another example, the first electronic processor 705 may comprise multiple electronic processors within the display device 120 that together function to control various aspects of the display device 120. Thus, in the claims, if an apparatus or system is claimed, for example, as including an electronic processor or other element configured in a certain manner, for example, to make multiple determinations, the claim or claim element should be interpreted as meaning one or more electronic processors (or other element) where any one of the one or more electronic processors (or other element) is configured as claimed, for example, to make some or all of the multiple determinations. In some embodiments, the display device 120 performs functionality other than the functionality described below.
[0062] The first memory 710 may include read only memory (ROM), random access memory (RAM), other non-transitory computer-readable media, or a combination thereof. The first electronic processor 705 is configured to receive instructions and data from the first memory 710 and execute, among other things, the instructions. In particular, the first electronic processor 705 executes instructions stored in the first memory 710 to perform the methods described herein.
[0063] The first network interface 715 sends data to and receives data from other devices within the audio playback system 600 (e.g., the auxiliary speaker 205, the audio receiver 140, etc.) and / or external devices outside of the audio playback system 600 (e.g., a media serv er). In some embodiments, the first network interface 715 includes one or more transceivers for wirelessly communicating with the other devices within the audio playback system 600.Alternatively or in addition, the first network interface 715 may include a connector or port for receiving a wired connection to one or more of the other devices in the audio playback system 600 and / or external devices, such as connector to receive a coaxial cable. The first electronic processor 705 may receive media content (for example, audio data, video / image data, and / or the like) from external devices (e.g.. from media servers or the like that provide video and audio data to the display device 120 to be output by the display device 120) via the first network interface 715. The first electronic processor 705 may output the media content received from the external device(s) via the speaker 720, the display screen 725. or a combination thereof. In some instances, the speaker 720 may include a plurality of built-in speakers (e.g., two built-in speakers) as described previously herein.
[0064] The display screen 725 is configured to display images, video, text, and / or data to the user. The display screen 725 may be a liquid crystal display (LCD) screen or an organic light emitting display (OLED) display screen. In some embodiments, a touch sensitive input interface may be incorporated into the display screen 725 as well, allowing the user to interact with content provided on the display screen 725. In some embodiments, the display screen 725 includes future-developed display technologies. In some embodiments, the speaker 720 and the display screen 725 are referred to as output devices that output media content (e.g.. image / video and audio) and other information to a user 105 of the display device 120.
[0065] FIG. 8 is a hardware block diagram of the auxiliary speaker 205 according to some example embodiments. In the example shown, the auxiliary speaker 205 includes a second electronic processor 805 electrically connected to a second memory 810, a second network interface 815, and a speaker 820. These components are similar to the like-named components of the display device 120 explained above with respect to FIG. 7 and function in a similar manner as described above. For example, the second electronic processor 805 sends and receives data to and from one other devices within the audio playback system 600 and / or external devices outside of the audio playback system 600 via the second network interface 815. In some instances, the speaker 820 may include multiple speakers 820, for example, three separate speakers that may be used to provide separate audio channels as described previously herein. The speaker(s) 820 may be configured to output audio content from the display device 120 or associated with the display device 120. In some instances, the auxiliary speaker 205 includes fewer or additional components in configurations different from that illustrated in FIG. 8. For example, the auxiliary speaker 205 may additionally include a display such as a touch screen and / or other user input devices to allow the user 105 to program settings of the auxiliary speaker 205. As another example, the second electronic processor 805 may comprise multipleelectronic processors that together function to control various aspects of the auxiliary speaker 205. Thus, in the claims, if an apparatus or system is claimed, for example, as including an electronic processor or other element configured in a certain manner, for example, to make multiple determinations, the claim or claim element should be interpreted as meaning one or more electronic processors (or other element) where any one of the one or more electronic processors (or other element) is configured as claimed, for example, to make some or all of the multiple determinations. In some instances, the auxiliary speaker 205 performs functionality other than the functionality described below.
[0066] FIG. 9 is a hardware block diagram of the audio receiver 140 according to some example embodiments. In the example shown, the audio receiver 140 includes a third electronic processor 905 electrically connected to a third memory' 910, a third network interface 15, and a display screen 920. These components are similar to the like-named components of the display device 120 explained above with respect to FIG. 7 and function in a similar manner as described above. For example, the third electronic processor 905 sends and receives data to and from one other devices within the audio playback system 600 and / or external devices outside of the audio playback system 600 via the third network interface 915. In some instances, the audio receiver 140 includes fewer or additional components in configurations different from that illustrated in FIG. 9. For example, the audio receiver 140 may additionally include user input devices (e g., dials, knobs, buttons, etc.) to allow the user 105 to program settings (e.g., volume of audio output) of the audio receiver 140 that are used to control other devices in the audio playback system 600. As another example, the third electronic processor 905 may comprise multiple electronic processors that together function to control various aspects of the audio receiver 140. Thus, in the claims, if an apparatus or system is claimed, for example, as including an electronic processor or other element configured in a certain manner, for example, to make multiple determinations, the claim or claim element should be interpreted as meaning one or more electronic processors (or other element) where any one of the one or more electronic processors (or other element) is configured as claimed, for example, to make some or all of the multiple determinations. In some instances, the audio receiver 140 performs functionality' other than the functionality described below.
[0067] FIG. 10 illustrates a flowchart of a method 1000 of generating audio content according to some example embodiments. The method 1000 is described as being performed by the electronic processor 705 (i.e., one or more electronic processors) of the display device 120. However, it should be understood that the electronic processor that performs the method 1000 described herein may include any one or a combination of electronic processors located within asingle device (e.g.. the display device 120, the auxiliary speaker 205. and / or the audio receiver 140) or distributed among various devices (e g., the display device 120, the auxiliary speaker 205, and / or the audio receiver 140) and / or systems. Thus, in the claims, if an apparatus or system is claimed, for example, as including an electronic processor or other element configured in a certain manner, for example, to make multiple determinations, the claim or claim element should be interpreted as meaning one or more electronic processors (or other element) where any one of the one or more electronic processors (or other element) is configured as claimed, for example, to make some or all of the multiple determinations. To reiterate, those electronic processors and processing may be confined to a single device or may be distributed amongst multiple devices. While a particular order of processing steps, message receptions, and / or message transmissions is indicated in FIG. 10 as an example, timing and ordering of such steps, receptions, and transmissions may vary where appropriate without negating the purpose and advantages of the examples set forth in detail throughout the remainder of this disclosure.
[0068] At block 1005, the electronic processor 705 of the display device 120 generates first audio content to be output by the speaker 720 of the display device 120. For example, the speaker 720 may include a pair of built-in speakers 720 of the display device 120 that are configured to provide stereo audio output when the auxiliary speaker 205 is not present. In some instances, the first audio content is generated based on device data of the display device 120 that indicates that a main axis of radiation of the speaker 720 relative to the display screen 725 of the display device 120 is in a first direction (e.g., an unmodified direction 125 A, 125B or 130 as shown in FIG. 1). For example, the device data may include a device descriptor that indicates whether any auxiliary speaker 205 is present (i.e., connected to the display device 120 and / or the audio receiver 140 to provide audio output). In some instances, the display device 120 may receive audio data that may be capable of being generated / output in multiple different manners (i.e., generating audio content in different manners) depending on the device data that indicates system specifications (e.g., whether the auxiliary speaker 205 is present, a number of auxiliary speakers 205 that are present, intended location(s) of one or more auxiliary speakers 205 relative to the display device 120, etc.) for different users that may have different sound systems.
[0069] In some instances, the first direction 125A, 125B, 130 of the main axis of radiation of the speaker 720 relative to the display screen 725 is downwards or sideways as shown in FIG. 1 (e.g., when sound guiding features are not present or deployed on the display device 120). In such instances, generating the first audio content includes generating the first audio content to provide a portion of stereo audio when the auxiliary speaker 205 is not present as shown in FIG.1 . In other w ords, the display device 120 may rely solely on its down-firing built-in speakers720 or solely on its side-firing built-in speakers 720 to provide stereo audio output. In this situation, the device data of the display device 120 may accordingly indicate that an auxiliary speaker 205 is not present and that audio output by the built-in speakers 720 provides a stereo audio output. Thus, based on the device data, the electronic processor 705 may generate the first audio content to be output as stereo audio output.
[0070] At block 1010, the electronic processor 705 determines a presence of the auxiliary speaker 205 configured to output audio associated with the display device 120 (e.g., audio associated with visual information output by the display screen 725 of the display device 120). In some instances, determining the presence of the auxiliary speaker 205 includes determining that the auxiliary speaker 205 has been connected (e.g., communicatively coupled) to the display device 120 and / or the audio receiver 140 to provide audio output associated with the displaydevice 120. For example, the electronic processor 705 may recognize that the auxiliary speaker 205 has been connected to a port of the display device 120 or has paired with the display device 120 by receiving identification information from the auxiliary speaker 205 that identifies a type and / or function of the auxiliary' speaker 205. Such identification information may additionally or alternatively be received from the audio receiver 140. In some instances, determining the presence of the auxiliary speaker 205 is based on a user input received by the electronic processor 705 via a user input device of the display device 120 or the audio receiver 140. For example, a remote control device or a joystick on the housing of the display device 120 may be used by the user 105 to select an option on a settings menu displayed on the display device 120 that indicates that the auxiliary speaker 205 has been connected to the display device 120.
[0071] At block 1015, the electronic processor 705 determines, based on determining the presence of the auxiliary speaker 205, that the main axis of radiation of the speaker (i.e., the built-in speaker(s) 720 of the display device 120) relative to the display screen 725 has been modified to be in a second direction different than the first direction. In some instances, the second direction 505 of the main axis of radiation of the speaker 720 relative to the displayscreen 725 is upward as shown in FIG. 5. In some instances, the electronic processor 705 determines that the main axis of radiation of the speaker 720 relative to the display screen 725 has been modified to be in the second direction solely based on determining the presence of the auxiliary speaker 205. For example, in response to determining the presence of the auxiliary’ speaker 205, the electronic processor 705 may be configured to assume that one or more sound redirecting features have been mounted to the display device 120 or deployed in order to modify the main axis of radiation of the built-in speakers 720. In other instances, the electronic processor 705 determines that the main axis of radiation of the speaker 720 relative to thedisplay screen 725 has been modified to be in the second direction based on a user input received by the electronic processor 705 via a user input device of the display device 120 or the audio receiver 140. For example, a remote control device or a joystick on the housing of the display device 120 may be used by the user 105 to select an option on a settings menu displayed on the display device 120 that indicates the second direction as modified by the user using sound redirecting features (e.g., the waveguide 400, adjustable sound guide features built-in to the display device, and / or the like). As described previously herein, in some instances, the display device 120 may include one or more sensors configured to detect deployment of adjustable sound guide features and / or mounting of the waveguide 400 and / or the auxiliary speaker 205 to the display device 120. In such embodiments, the electronic processor 705 may determine that the main axis of radiation of the speaker 720 relative to the display screen 725 has been modified to be in the second direction 505 based on detecting of such deployment and / or mounting. In some instances, the electronic processor 705 may also determine the second direction based on which combination of sensors indicate that sound guide features have been deployed and / or that a waveguide 400 has been mounted.
[0072] In some instances, determining that the main axis of radiation of the speaker 720 relative to the display screen 725 has been modified to be in the second direction 505 (at block 1015) includes determining, with the electronic processor 705, the second direction based on (i) information received from the auxiliary speaker 205, (ii) a detected position of a manually moveable sound guide feature of a housing of the display device 120, or (iii) both the information received from the auxiliary speaker 205 and the detected position of the manually moveable sound guide feature of the housing of the display device 120. For example, the auxiliary speaker 205 may transmit device information to the display device 120 (e.g., directly or via the audio receiver 140) that indicates a type of the auxiliary7speaker 205, an intended location of the auxiliary speaker 205 relative to the display screen 725 of the display device 120. and / or types of audio channels provided by the auxiliary speaker 205. Based on the device information of the auxiliary speaker 205, the electronic processor 705 maybe configured to assume a certain second direction, control actuators to obtain a certain second direction as explained below, and / or provide a notification to the user to make manual adjustments to obtain a certain second direction as explained below.
[0073] In some instances, the electronic processor 705 determines the second direction 505 based on information received from the auxiliary speaker 205 and / or based on the user input received via the user input device. In response to determining the second direction 505, the electronic processor 705 may control an actuator to move an adjustable / moveable sound guidefeature (e.g.. flap, manifold, etc.) built-in to the housing of the display device 120 to a deployed position to block sound from the built-in speakers from being emitted in the first direction 125 A, 125B, 130 or guide or reflect sound emitted by the built-in speakers to be in the second direction 505. Additionally or alternatively, in response to determining the second direction 505, the electronic processor 705 may provide a notification to a user 105 via the display device 120. where the notification instructs the user 105 to move a manually moveable sound guide feature of the housing of the display device 120 to a deployed position to block sound from the built-in speakers from being emitted in the first direction 125 A, 125B, 130 or guide or reflect sound emitted by the built-in speakers to be in the second direction 505. In some instances, determining that the main axis of radiation of the speaker 720 (i.e., a built-in speaker 720) relative to the display screen 725 has been modified to be in the second direction 505 different than the first direction 125A, 125B, 130 includes controlling one or more actuators to move one or more adj ustable / moveable sound guide features and / or providing the notification to the user 105.
[0074] As indicated in some of the examples above, the method 700 may include coupling a waveguide 400 (e.g., one or more waveguides 400) to the display device 120 (e.g., when an auxiliary speaker 205 is communicatively coupled to the display device 120). As explained previously herein, the waveguide 400 is configured to capture sound emitted by the speaker (e.g., a built-in speaker 720 of the display device 120) in the first direction and redirect the sound such that the main axis of radiation of the sound relative to the display screen 725 is in the second direction that is different than the first direction.
[0075] At block 1020, in response to determining that the main axis of radiation of the speaker 720 relative to the display screen 725 has been modified to be in the second direction, the electronic processor 705 modifies the device data of the display device 120 that indicates the main axis of radiation of the speaker relative to the display screen 725. In some instances, modifying the device data of the display device 120 includes modifying the device data (e.g., to create modified device data) to indicate that the main axis of radiation of the speaker 720 relative to the display screen 725 is in the second direction (e g., the second direction 505 shown in FIG. 5). The specific second direction may be determined (e.g., assumed or specifically determined) in any one or more of the manners described previously herein (e g., based on user input, based on sensed data from sensors, based on a type of the auxiliary' speaker 205, etc.).
[0076] At block 1025, the electronic processor 705 generates second audio content to be output by the speaker 720 of the display device 120. The second audio content may begenerated based on the device data of the display device 120 (i.e., modified device data) that indicates that the main axis of radiation of the speaker 720 relative to the display screen 725 is in the second direction that is different than the first direction (i.e., that indicates that the main axis of radiation of the built-in speaker(s) 720 of the display device 120 has been modified). In some instances, the second audio content is generated differently than the first audio content due to the main axis of radiation of the speaker 720 relative to the display screen 725 being modified from the first direction to the second direction. For example, the first audio content may be generated to provide a portion of stereo audio content outward or downward from the display device 120 when the auxiliary speaker 205 is not present as explained above with respect to block 1005. On the other hand, the second audio content may be generated to provide a height sound channel when the auxiliary speaker 205 is present because the auxiliary speaker 205 may be configured to provide forward-facing audio channels that would otherwise overlap with outward or downward stereo audio content. In other words, the electronic processor 705 may generate the second audio content (e.g.. by decoding a different signal and / or by applying an ear / pinna filter related to height channel sound output to a signal) to provide a first sound channel in an audio system (e.g., a height sound channel). Additionally, the electronic processor 705 may generate third audio content to be output by the auxiliary speaker 205 to provide a second sound channel in the audio system (e.g., a forward-facing sound channel). As shown in FIG. 5, the auxiliary speaker 205 includes a second speaker 820 with a second main axis of radiation 210 relative to the display screen 725 that is different than the main axis of radiation 505 of the speaker 720 of the display device 120. For another example, see FIG. 11B. Accordingly, the audio playback system may be modified using sound redirection features and by controlling audio output differently when an auxiliary speaker 205 is present in order to include an increased number of total independent sound channels that provide a more immersive audio experience for the user 105.
[0077] In some instances, the speaker 720 of the display device 120 includes a first speaker 720 and a second speaker 720 (e.g., two built-in speakers 720). In some instances, the second direction of the main axis of radiation for both the first speaker 720 and the second speaker 720 relative to the display screen 725 is the same (e.g., an upward direction 505 shown in FIG. 5). In some instances, the electronic processor 705 generates the second audio content to provide a distinct height sound channel using each of the first speaker 720 (e.g., that provides a left height sound channel) and the second speaker 720 (e.g., that provides a right height sound channel). In other instances, the electronic processor 705 generates the second audio content to provide adedicated height center sound channel using a combination of the first speaker 720 and the second speaker 720.
[0078] In some instances, the first direction of the main axis of radiation of a built-in speaker 720 of the display device 120 and the second direction (e.g., modified direction) of the main axis of radiation of the built-in speaker are different from each other by at least approximately thirty degrees. For example, FIGS. 1 and 5 illustrates the first direction 125A, 125B and 130 being different than the second direction 505 by approximately 90 degrees and approximately 180 degrees, respectively, in a plane defined by the display screen 725. Other angle differences between the first direction and the second direction are possible in the same plane or in one or more different planes in three-dimensional space.
[0079] In some instances, the electronic processor 705 determines the second direction (i) based on information received from the auxiliary speaker 205, (ii) based on a type of the second audio content, or (iii) based on both the information received from the auxiliary speaker 205 and the type of the second audio content. For example, in response to determining that device information of the auxiliary speaker 205 indicates that the auxiliary speaker 205 already includes a height sound channel, the electronic processor 705 may determine that the second direction (e.g., a modified direction of the built-in speakers 720) should be used to provide surround sound or dialogue sound in a certain direction. On the other hand, in response to determining that device information of the auxiliary' speaker 205 indicates that the auxiliary speaker 205 does not include a height sound channel, the electronic processor 705 may determine that the second direction should be upwards to provide one or more height sound channels. As another example, in response to determining that the type of the second audio content is associated with a movie being played on the display device 120, the electronic processor 705 may determine that the second direction is upward to provide one or more height sound channels. On the other hand, in response to determining that the type of the second audio content is associated with music being played by the display device 120 or a news program being played by the display device 120, the electronic processor 705 may determine that the second direction should be forward-facing to provide a center channel dialogue.
[0080] In some instances, in response to determining the second direction as explained immediately above, the electronic processor 705 may at least one of (i) control an actuator to move a sound guide feature of a housing of the display device 120, and (ii) provide a notification to a user via the display device 120, where the notification instructs the user to move a manually moveable sound guide feature of the housing of the display device 120. Accordingly, a soundguide feature may be deployed and / or mounted to the display device 120 to direct sound from a built-in speaker 720 of the display device 120 to a desired second direction based on information received from the auxiliary speaker 205 and / or based on a t pe of the second audio content.
[0081] It is to be understood that the embodiments are not limited in its application to the details of the configuration and arrangement of components set forth herein or illustrated in the accompanying drawings. The embodiments are capable of being practiced or of being carried out in various ways. Also, it is to be understood that the phraseology and terminology used herein are for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof are meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless specified or limited otherwise, the terms “mounted,” “connected,” “supported,” and “coupled” and variations thereof are used broadly and encompass both direct and indirect mountings, connections, supports, and couplings. The terms “substantially,” “essentially,” “approximately.” “about” or any other version thereof, are defined as being close to as understood by one of ordinary skill in the art, and in one non-limiting embodiment the term is defined to be within 10%, in another embodiment within 5%, in another embodiment within 1% and in another embodiment within 0.5%.
[0082] In addition, it should be understood that embodiments may include hardware, software, and electronic components or modules that, for purposes of discussion, may be illustrated and described as if the majority of the components were implemented solely in hardware. However, one of ordinary skill in the art, and based on a reading of this detailed description, would recognize that, in at least one embodiment, the electronic-based aspects may be implemented in software (e.g., stored on non-transitory computer-readable medium) executable by one or more electronic processors, such as a microprocessor and / or application specific integrated circuits (“ASICs”). As such, it should be noted that a plurality of hardware and software based devices, as well as a plurality of different structural components, may be utilized to implement the embodiments. For example, “servers” and “computing devices” described in the specification can include one or more electronic processors, one or more computer-readable medium modules, one or more input / output interfaces, and various connections (e.g., a system bus) connecting the various components.
[0083] Various features and advantages are set forth in the following claims.
Claims
CLAIMSWhat is claimed is:
1. A method of generating audio content, the method comprising: generating, with an electronic processor, first audio content to be output by a speaker of a display device, wherein the first audio content is generated based on device data of the display device that indicates that a main axis of radiation of the speaker relative to a display screen of the display device is in a first direction; determining, with the electronic processor, a presence of an auxiliary speaker configured to output audio associated with the display device; determining, with the electronic processor and based on determining the presence of the auxiliary speaker, that the main axis of radiation of the speaker relative to the display screen has been modified to be in a second direction different than the first direction; in response to determining that the main axis of radiation of the speaker relative to the display screen has been modified to be in the second direction, modifying the device data of the display device, that indicates the main axis of radiation of the speaker relative to the display screen, to indicate that the main axis of radiation of the speaker relative to the display screen is in the second direction; and generating, with the electronic processor, second audio content to be output by the speaker, wherein the second audio content is generated based on the device data of the display device that indicates that the main axis of radiation of the speaker relative to the display screen is in the second direction, wherein the second audio content is generated differently than the first audio content due to the main axis of radiation of the speaker relative to the display screen being modified from the first direction to the second direction.
2. The method of claim 1, wherein the first direction of the main axis of radiation of the speaker relative to the display screen is downwards or sideways, and wherein generating the first audio content includes generating the first audio content to provide a portion of stereo audio when the auxiliary speaker is not present; wherein the second direction of the main axis of radiation of the speaker relative to the display screen is upward, and wherein generating the second audio content includes generating the second audio content to provide a height sound channel when the auxiliary speaker is present.
3. The method of claim 1 or claim 2, wherein generating the second audio content includes generating the second audio content to provide a first sound channel in an audio system, and further comprising: generating, with the electronic processor, third audio content to be output by the auxiliary' speaker to provide a second sound channel in the audio system, wherein the auxiliary’ speaker includes a second speaker with a second main axis of radiation relative to the display screen that is different than the main axis of radiation of the speaker of the display device.
4. The method of any one of the preceding claims, further comprising receiving, yvith the electronic processor, a user input via a user input device; wherein determining the presence of the auxiliary speaker is based on the user input; wherein determining that the main axis of radiation of the speaker relative to the display screen has been modified to be in the second direction different than the first direction is based on the user input; and wherein modifying the device data of the display device, that indicates the main axis of radiation of the speaker relative to the display screen, to indicate that the main axis of radiation of the speaker relative to the display screen is in the second direction is based on the user input.
5. The method of any one of the preceding claims, wherein the second direction is defined at least partially by at least one of a group consisting of a waveguide coupled to the display device, an adjustable sound guide feature on the display device, a sound guide feature on the auxiliary speaker, a rear surface of the display device, a surface behind the display device that faces the rear surface of the display device, and combinations thereof.
6. The method of any one of the preceding claims, yvherein the first direction and the second direction are different from each other by at least thirty degrees.
7. The method of any one of the preceding claims, wherein determining that the main axis of radiation of the speaker relative to the display screen has been modified to be in the second direction includes determining, yvith the electronic processor, the second direction based on information received from the auxiliary speaker, a detected position of a manually moveable sound guide feature of a housing of the display device, or both the information received from the auxiliary speaker and the detected position of the manually moveable sound guide feature of the housing of the display device.
8. The method of any one of claims 1-6, further comprising: determining, with the electronic processor, the second direction based on information received from the auxiliary speaker, based on a type of the second audio content, or based on both the information received from the auxiliary speaker and the type of the second audio content; and in response to determining the second direction, at least one of controlling an actuator to move a sound guide feature of a housing of the display device, and providing a notification to a user via the display device, wherein the notification instructs the user to move a manually moveable sound guide feature of the housing of the display device.
9. The method of any one of the preceding claims, further comprising coupling a waveguide to the display device, wherein the waveguide is configured to capture sound emitted by the speaker in the first direction and redirect the sound such that the main axis of radiation of the sound relative to the display screen is in the second direction.
10. The method of any one of the preceding claims, wherein the speaker includes a first speaker and a second speaker, and wherein the second direction of the main axis of radiation for both the first speaker and the second speaker is the same; wherein the second direction of the main axis of radiation of the speaker relative to the display screen is upward, and wherein generating the second audio content includes generating the second audio content to provide a distinct height sound channel using each of the first speaker and the second speaker or a dedicated height center sound channel using a combination of the first speaker and the second speaker.
11. The method of any one of the preceding claims, wherein the electronic processor includes at least one of the group consisting of one or more electronic processors of the display device, one or more electronic processors of an audio receiver, one or more electronic processors of the auxiliary speaker, or combinations thereof; wherein the audio receiver is communicatively coupled to the display device, the auxiliary speaker, or both the display device and the auxiliary speaker; and wherein the auxiliary speaker is communicatively coupled to the display device, the audio receiver, or both the display device and the audio receiver.
12. An audio playback system comprising: the electronic processor; and a memory storing instructions, which when executed by the electronic processor, cause the audio playback system to perform the method of any one of claims 1-11.
13. A non-transitory computer-readable storage medium storing instructions which, when executed by a computing apparatus, cause the computing apparatus to perform the method of any one of claims 1-11.
Citation Information
Patent Citations
Display apparatus and sound outputting method thereof
US20210200264A1
Audio integration of portable electronic devices for enclosed environments
US20230217202A1
Rendering based on loudspeaker orientation
WO2023086303A1