Non-Isolated Dual Driver Earphones

The head-mounted audio reproduction device addresses the challenge of achieving high-fidelity audio and non-blocking ambient sound perception by using strategically positioned woofer and tweeter components, enhancing the audio stage and maintaining environmental awareness.

JP7595726B2Active Publication Date: 2024-12-06MAGIC LEAP INC
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023173605
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2017-03-30
Filing Date
2023-10-05
Publication Date
2024-12-06
Estimated Expiration
2038-03-30

AI Technical Summary

Technical Problem

Existing head-mounted audio reproduction devices struggle to provide a high-fidelity listening experience while also being non-blocking, allowing ambient sounds to be perceived without significant diminishment, thus compromising either fidelity or openness.

Method used

A head-mounted audio reproduction device with left and right woofer and tweeter components positioned outside the ear canal, driven by an input circuit to provide high-fidelity audio and maintain perception of ambient sound, featuring a configuration that extends the audio stage by spacing the tweeter further from the ear canal.

Benefits of technology

The device achieves high-fidelity bass and a broader audio stage without blocking ambient sound, providing a more natural listening experience by integrating woofer and tweeter components in a non-isolating form factor.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007595726000001
    Figure 0007595726000001
  • Figure 0007595726000002
    Figure 0007595726000002
  • Figure 0007595726000003
    Figure 0007595726000003
Patent Text Reader

Abstract

To provide a head-worn audio speaker system that produces a high fidelity listening experience (including high fidelity bass) while incoming sounds and the perception of the surrounding space are substantially not affected.SOLUTION: A head-worn audio speaker system 250 includes: a left woofer component 272; a left tweeter component 274; a mounting attachment extension 278 that is a left support structure and supports the left woofer component and the left tweeter component such that a left woofer sound outlet is spaced from a left tweeter sound outlet 274a by at least 1 / 2 centimeter; a right woofer component 282; a right tweeter component 284; and a mounting attachment extension 288 that is a right support structure and supports the right woofer component and the right tweeter component such that a right woofer sound outlet is spaced from a right tweeter sound outlet by at least 1 / 2 centimeter.SELECTED DRAWING: Figure 2B
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] (Priority Claim) This application claims priority to U.S. Provisional Patent Application No. 62 / 478,938, filed March 30, 2017.

[0002] The present invention relates to head mounted audio speaker systems. [Background technology]

[0003] The field of head-mounted (head-wearable) sound reproduction encompasses several different types of devices that have been developed since the early days of electronic audio. The most common head-mounted sound reproduction devices include around-ear headphones, which are speakers mounted on cups that encompass the ears and other parts of the head; over-ear headphones, which are speakers with pads that press against the ears; earphones, colloquially known as earbuds, that fit into the outer ear; and in-ear headphones or monitors that are inserted into the ear canal. In some cases, head-mounted sound reproduction devices include a support band that spans across the head. In other cases, head-mounted sound reproduction devices include clips that hang from each ear, and in still other cases, the head-mounted sound reproduction devices are held in place by the ear canal itself.

[0004] Recently, head-mounted audio playback devices have been integrated into virtual reality and augmented reality headgear. These devices, such as the Oculus Rift and Meta from Oculus VR (Menlo Park, Calif.), typically have some type of wearable eyewear that includes built-in or attached speakers, such as over-ear earphones or speakers mounted in or on the arms or frame of the eyewear.

[0005] Historically, within the field of head-mounted sound reproduction, there have been two alternative goals that drove product development: (1) high-fidelity devices, whose goal was to reproduce as accurately as possible the full frequency spectrum of the audio being reproduced, and (2) "non-obstructed" devices, whose goal was to allow external sounds from the surroundings to be perceived unaffected. These two goals have tended to work against one another (be mutually exclusive), resulting in a functional division within the industry that has persisted over the course of decades of audio technology development.

[0006] When high fidelity is the goal and truly non-occluding is not important, head-mounted sound reproduction excels in providing a long-lasting, effective product. For example, full-size headphones have been used by professional audio engineers for nearly a century. These devices provide high fidelity audio but are ineffective in being non-occluding, i.e., covering both ears with around-ear cups that compromise the fidelity with which ambient sounds in the environment can be heard. Similarly, earbuds (commonplace these days) that insert partially or deeply into the ear canal rely on a "good seal" in the ear canal so that the ear canal can act as a closed chamber in which bass sounds resonate. Around-ear cups and sealed earbuds block the free flow of air between the surrounding environment and the ear canal (i.e., impede "fluid communication"), and in so doing, also substantially reduce the hearing of ambient sounds. Earbuds made by Apple (Cupertino, CA) are an example of consumer earbuds, while professional "in-ear monitor" products are available from companies such as Shure (Niles, IL), Sennheiser (Wedemark, Germany), and Westone (Colorado Springs, CO). Like full-size headphones, these devices may seem nice, but are ineffective in being non-isolating. In fact, in many cases the intention is to block out as much outside sound as possible so that the user can be fully immersed in the content.

[0007] In recent years, perhaps in response to an increasing number of people wearing head-mounted audio playback in public, where not being able to hear one's surroundings can lead to social friction or pose a danger to oneself or others, headphone and earphone companies have marketed more products that are labeled "open-air," "open-back," or "non-occlusive." These products typically have a form factor similar to their "occlusive" and "closed-air" siblings, but with the inclusion of pass-through tunnels, openings, or other features that allow a greater amount of sound to pass through from the outside world. These pass-through tunnels, openings, or other features provide a restricted path that limits the fidelity with which ambient sounds can be heard. However, despite their marketing terminology, these products typically still block or alter incoming sounds from the outside world to a significant degree. One need only compare the experience of wearing one of these devices with or without audio being played to the extent to which one can "feel" the difference in the degree to which one can hear or perceive outside sounds.

[0008] In the past few years, a new type of closed earbud has emerged that has an external microphone to capture external sounds from the immediate environment, which are then mixed with other audio being output through the earbud so that the external sounds can be heard more clearly. One example of such an earbud is sold under the name "Here" by Doppler Labs (San Francisco, California). This approach can recreate the gist of the surrounding sound with even good accuracy, but the fact that it is reproduced unnaturally removes a great deal of the nuance and subtlety that sounds natural to humans.

[0009] The aforementioned devices still fall very far short of being able to recreate an experience that matches what people are accustomed to hearing and sensing their environment when their ears are unobstructed. In short, high-fidelity "pass-through" devices fall short of being truly non-obstructing, as they all significantly alter the perception of incoming natural sounds. Listeners tend to feel "cut off" from the surrounding space and hear in a greatly diminished sound stage.

[0010] At the other end of the high-fidelity / non-occluded divide, head-mounted audio reproduction has been successful in being non-occluded when audio fidelity is not important.

[0011] "Open-air" hearing aids are a common example. There are a variety of different form factors for hearing aids, not all of which are non-obstructive, but over time there has been an increasing goal of allowing incoming natural sound to enter the ear canal (along with the capture and amplification of sound, which is the primary purpose of the hearing aid). Open-air hearing aids typically use behind-the-ear form factors, where the majority of the device rests behind the ear, with a small tube connecting to an ear mold or earpiece. This form factor spans a range across the fidelity vs. openness tradeoff, as some ear molds completely block the ear canal opening and others do not. An example towards the open side is the "balanced armature" driver, which is mounted in a hollow cylinder so that the driver essentially "floats" in the middle of the ear canal, leaving the ear canal effectively unobstructed from the perspective of external sound perception. However, the audio fidelity of these devices is well below high fidelity, especially in terms of high fidelity bass. While this may not be a significant issue for hearing aids (because hearing loss often affects higher frequencies more than bass), these designs are far from being delivery systems for electronically delivered audio such as music, movies, games, etc.

[0012] Another approach to achieving non-occluded head-mounted audio is represented by headsets designed for dispatchers, and more recently, by certain headsets designed for talking on cell phones, where only one ear is masked by the sound source, leaving the other ear unmasked and devoid of audio, essentially creating a "50-50 split" between the competing goals of fidelity and openness (by using one ear for each goal). As with hearing aids, this approach is effective for some scenarios, but falls far short of being a true solution as it fails to really succeed at either goal.

[0013] Other applications for audio playback systems include virtual reality, augmented reality, and mixed reality. For virtual reality, augmented reality, and mixed reality, the audio requirements are comparable to those of the visual display. For virtual reality, where the visual display blocks light from the outside world, it is desirable for audio to do the same for sound, so over-ear headphones and tightly sealed earbuds tend to be effective solutions. However, for augmented reality and mixed reality, where the visual display allows light from the outside world to enter, it would be desirable (at least most of the time) for audio to do the same for sound. Thus, for an augmented reality device, speakers could be mounted on both sides of the device and used to project sound into the user's ears from up to a few centimeters away. Such a configuration is expected to excel in being non-occluding, but would leave a lot to be desired in terms of audio fidelity. In particular, bass frequency reproduction tends to be a particularly weak area, which works against the overall goal of suspension of disbelief.

[0014] One of the problems with "open-back" or "open-air" high fidelity headphones is that by allowing sound to come in, they also allow sound to get out. This means that any audio being heard is not private, but is at least to some extent projected out into the surroundings. Often this is a weak, tinny sound projection, but still clearly audible to anyone in the vicinity when there is little background noise. For at least some users, the gains offered by these products (such as a wider "sound stage" and a feeling of being less "closed off from the world") are significant enough to offset this loss of privacy.

[0015] Devices that produce bass frequencies at hi-fi quality face a trade-off between device weight and sealing the ear canal. This trade-off stems from the large size of the bass waveform (nearly 30 feet for low notes on an acoustic bass). The essence of this trade-off is the premise that small and lightweight devices (such as earbuds that weigh less than an ounce) can only produce convincing bass by blocking the ear canal. The rationale is that once the sound source moves outside the ear canal, it becomes much more difficult to generate airborne waveforms strong enough to register as hi-fi bass, and the size and gravity of the hardware needed to do this dictates form factors such as full-sized headphones (which can weigh up to a pound or more).

[0016] None of the head-mounted audio reproduction devices discussed above can simultaneously provide a completely high-fidelity listening experience and a completely unobstructed listening experience; there is always a substantial compromise in either one or the other, or both. Nevertheless, in recent years, personal listening devices and mobile phones have driven a surge in the adoption of head-mounted audio reproduction, with more and more people spending more and more time in more and more places with their ears partially or completely blocked. As a result, people everywhere are becoming more disconnected from their surroundings, resulting in social friction, safety hazards, and in many cases, hearing damage.

[0017] What is needed is a head-mounted sound reproduction device in a small and lightweight form factor that produces a high-fidelity listening experience (including high-fidelity bass), while also being non-obstructive so that the perception of the incoming sound and surrounding space is not substantially affected. What is also needed is a head-mounted sound reproduction device that provides a broader and more clearly defined "sound stage" than is generally available from head-mounted listening devices, and therefore an enhanced listening experience. Summary of the Invention [Means for solving the problem]

[0018] The head-mounted (head-wearable) sound reproduction device includes left and right woofer components, left and right tweeter components, one or more mounting attachments for holding the left and right woofer and tweeter components in place, and an input circuit component. The woofer component is mounted just outside the ear canal, and the tweeter component is mounted outside the ear canal, both driven through an input circuit that may be configured in various ways to receive a stereo input signal from an external source. The design and placement of these components results in a high-fidelity listening experience, including high-fidelity bass, while also being non-obstructing, such that the user's perception of ambient sound and surrounding space is not substantially diminished.

[0019] The disclosed device allows a user to move around the world listening to high fidelity audio, such as music, movies, games, etc., without having their perception of the surrounding space diminished by physical obstructions. This achievement neutralizes one of the long-standing feature trade-offs that has existed in the head-worn audio industry since its inception, where a device has always had to compromise either its high fidelity performance or its non-obstructed effectiveness. The present device meets both goals without compromising either.

[0020] In addition, some disclosed devices are configured with tweeters located farther from the ear canal than woofers, which can provide an unexpectedly fascinating "sound stage expansion." The effect is not only a quantitatively larger sound stage than that of headphones or earbuds, but also qualitatively different. Existing headphones and earbuds make the sound feel like it is coming from inside or near the head ("small sound stage"), while not adding any environmental ambience, so the sound is "pure" (only what is delivered). In contrast, traditional external speakers make the sound feel like it is coming from outside in the environment ("large sound stage"), but the sound is "impure" because it is also mixed with environmental ambience (reflections, reverberation) by the time it reaches the ear.

[0021] Unlike previous approaches, the present device, in its "augmented" configuration, creates the sensation that sound originates externally in the environment ("large sound stage"), but the sound is still "pure" as it reaches the ears in that there is no indication of the environmental ambience. The listening experience is not just an interpolation between the two familiar listening experiences of audio on headphones or external speakers. Listening to a "large sound stage" with "no environmental ambience" is unfamiliar and unexpected, but also extremely fascinating, and the effect is "organic," as in the present method of delivering audio fits more naturally with the human auditory system than either conventional earphones or external speakers.

[0022] Other variations of the disclosed devices include, but are not limited to, different designs for the woofer and tweeter components, passive, active, and active bi-amp configurations for the input circuitry, analog, USB, and wireless variations for the active input circuitry, and various forms of on-board attachment. Additionally, embodiments of "mixed reality" devices are disclosed that incorporate audio devices in various ways. For example, the present application provides the following: (Item 1) 1. An audio reproduction system, comprising: A head-wearable device, a left woofer component including a left woofer audio outlet; a left tweeter component including a left tweeter audio outlet; a left support structure for supporting the left woofer component and the left tweeter component such that the left woofer sound outlet is spaced from the left tweeter sound outlet by at least 1 / 2 centimeter; and a right woofer component including a right woofer audio outlet; a right tweeter component including a right tweeter audio outlet; a right support structure for supporting the right woofer component and the right tweeter component such that the right woofer sound outlet is spaced from the right tweeter sound outlet by at least 1 / 2 centimeter; Head-wearable devices, including An audio reproduction system comprising: (Item 2) the left woofer sound outlet is spaced from the left tweeter sound outlet by at least 2 centimeters; 2. The sound reproduction system of claim 1, wherein the right woofer sound outlet is spaced from the right tweeter sound outlet by at least 2 centimeters. (Item 3) the head-wearable device is configured for mounting on a head at a mounting position; the left and right support structures are shaped to support the left and right woofer components such that, when the head-wearable device is in the mounted position on an appropriately sized IEC 60318-7 audio test dummy head, the left and right woofer audio outlets are within 1.5 centimeters of the left and right ear canal openings, respectively, of the left and right pinna of the IEC 60318-7 audio test dummy head; the head-wearable device includes an air impermeable material including at least a portion of the left and right woofer components, the left and right tweeter components, and the left and right support structures; 2. The audio reproduction system of claim 1, wherein when the head-wearable device is in the mounting position on an appropriately sized IEC 60318-7 audio test dummy head, for a center of a left ear canal opening of the audio test dummy head, the air impermeable portion is for less than 80% of a portion of a 4π solid angle centered on the center point of the left ear canal opening that is not covered by the IEC 60318-7 audio test dummy head itself, and for a center of a right ear canal opening of the audio test dummy head, the air impermeable portion is for less than 80% of a portion of a 4π solid angle centered on the center point of the right ear canal opening that is not covered by the IEC 60318-7 audio test dummy head itself. (Item 4) the right support structure for supporting the right woofer component and the right tweeter component is configured such that the right woofer sound outlet is spaced from the right tweeter sound outlet by less than 6 centimeters; 4. The sound reproduction system of claim 3, wherein the left support structure for supporting the left woofer component and the left tweeter component is configured such that the left woofer sound outlet is spaced from the left tweeter sound outlet by less than 6 centimeters. (Item 5) 4. The audio reproduction system of claim 3, further comprising an input circuit, the input circuit having at least one input for receiving an audio signal, a left woofer output coupled to the left woofer component, a left tweeter output coupled to the left tweeter component, a left woofer channel delay between the at least one input and the left woofer output, a right woofer output coupled to the right woofer component, a right tweeter output coupled to the right tweeter component, and a right channel delay between the at least one input and the right woofer output. (Item 6) The input circuit further includes: at least one input for receiving an audio signal, a left woofer output coupled to the left woofer component, a left tweeter output coupled to the left tweeter component, a right woofer output coupled to the right woofer component, and a right tweeter output coupled to the right tweeter component; a left audio signal filter coupled to the at least one input and drivingly coupled to the left woofer component through the left woofer output, the left audio signal filter configured to apply a first gain to at least a first frequency band within a first frequency range extending from 20 Hz to 100 Hz and a second gain to at least a second frequency band within a second frequency range extending up to 100 Hz, the first gain substantially exceeding the second gain; a right audio signal filter coupled to the at least one input and drivingly coupled to the right woofer component through the right woofer output, the right audio signal filter configured to apply the first gain to at least the first frequency band and the second gain to at least the second frequency band; 4. The audio reproduction system according to item 3, comprising: (Item 7) 7. The audio reproduction system of claim 6, wherein the first gain exceeds the second gain by at least 10 dB. (Item 8) Item 9. The audio reproduction system of item 2, wherein the support structure comprises an ear clip mounting structure. 4. The audio reproduction system of claim 3, wherein the support structure comprises a head-straddling mounting attachment. (Item 10) An augmented reality device comprising the audio reproduction system according to item 2, Left transparent display eyepiece, Right transparent display eyepiece, a left-eye projector optically coupled to the left transparent display eyepiece; a right-eye projector optically coupled to the right transparent display eyepiece; a video and audio processing system coupled to the left-eye projector, the right-eye projector, the left woofer component, the left tweeter component, the right woofer component, and the right tweeter component, configured to generate virtual video and audio content; The augmented reality device further comprises: (Item 11) 3. The sound reproduction system according to claim 2, wherein the air impermeable portion is for at least 20% of a portion of a 4π solid angle centered on the center point of the left ear canal opening that is not covered by the IEC 60318-7 audio test dummy head itself, and for the center point of the right ear canal opening of the audio test dummy head, the air impermeable portion is for at least 20% of a portion of a 4π solid angle centered on the center point of the right ear canal opening that is not covered by the IEC 60318-7 audio test dummy head itself. (Item 12) 1. An audio reproduction system, comprising: A head-wearable device, a left woofer component including a left woofer sound outlet not configured for sealingly engaging within a left ear canal; a left tweeter component including a left tweeter audio outlet; a left support structure for supporting the left woofer component and the left tweeter component such that the left woofer sound outlet is spaced from the left tweeter sound outlet by at least 2 centimeters; and a right woofer component including a right woofer sound outlet not configured for sealingly engaging within a right ear canal; a right tweeter component including a right tweeter audio outlet; a right support structure for supporting the right woofer component and the right tweeter component such that the right woofer sound outlet is spaced from the right tweeter sound outlet by at least 2 centimeters; Head-wearable devices, including An audio reproduction system comprising: (Item 13) Item 13. The audio reproduction system of item 12, further comprising an input circuit, the input circuit having at least one input for receiving an audio signal, a left woofer output coupled to the left woofer component, a left tweeter output coupled to the left tweeter component, a left woofer channel delay between the at least one input and the left woofer output, a right woofer output coupled to the right woofer component, a right tweeter output coupled to the right tweeter component, and a right channel delay between the at least one input and the right woofer output. (Item 14) Item 13. The audio reproduction system of item 12, wherein the left and right support structures are shaped to support the left and right woofer components such that, when the head-wearable device is in the mounted position on an appropriately sized IEC 60318-7 audio test dummy head, the left and right woofer audio outlets are within 1.5 centimeters of the central opening of the left and right ear canals of the IEC 60318-7 audio test dummy head, respectively. (Item 15) The input circuit further includes: at least one input for receiving an audio signal, a left woofer output coupled to the left woofer component, a left tweeter output coupled to the left tweeter component, a right woofer output coupled to the right woofer component, and a right tweeter output coupled to the right tweeter component; a left audio signal filter coupled to the at least one input and drivingly coupled to the left woofer component through the left woofer output, the left audio signal filter configured to apply a first gain to at least a first frequency band within a first frequency range extending from 20 Hz to 100 Hz and a second gain to at least a second frequency band within a second frequency range extending up to 100 Hz, the first gain substantially exceeding the second gain; a right audio signal filter coupled to the at least one input and drivingly coupled to the right woofer component through the right woofer output, the right audio signal filter configured to apply the first gain to at least the first frequency band and the second gain to at least the second frequency band; Item 15. An audio reproduction system according to item 14, comprising: (Item 16) a left crossover filter having a crossover frequency, the left audio signal filter being a low pass filter contained within the left crossover filter, and the second frequency range extending from 100 Hz up to the crossover frequency; a right crossover filter, the right audio signal being included in the right crossover filter; Item 16. The audio playback system of item 15, further comprising: (Item 17) Item 13. An augmented reality device comprising the audio reproduction system according to item 12, Left transparent display eyepiece, Right transparent display eyepiece, a left-eye projector optically coupled to the left transparent display eyepiece; a right-eye projector optically coupled to the right transparent display eyepiece; a video and audio processing system coupled to the left-eye projector, the right-eye projector, the left woofer component, the left tweeter component, the right woofer component, and the right tweeter component, configured to generate virtual video and audio content; The augmented reality device further comprises: (Item 18) A head-wearable device, a first speaker component; a second speaker component; and a support structure configured to support the first speaker component proximate to an ear of a user and to movably support the second speaker component such that the second speaker component may be moved from at least a first position spaced a first distance from the first speaker component to a second position spaced a second distance from the second speaker component, the second distance exceeding the first distance; a sensor for sensing a position of the speaker and outputting a position indicating signal; an input circuit having at least one input for receiving an audio signal, a first output coupled to the first speaker component and a second output coupled to the second speaker component, the input circuit configured to provide a first output audio signal at the first output and a second output signal at the second output, a signal processing circuit interposed between the at least one input and the second output for processing the input audio signal to generate the second output signal, the signal processing circuit being drivingly coupled to the second speaker component and coupled to the sensor, the signal processing circuit being configured to delay the second output signal relative to the first output signal by a delay amount that is dependent on the position indicating signal; Head-wearable devices, including An audio reproduction system comprising: (Item 19) 20. The audio reproduction system of claim 18, wherein the signal processing circuitry is configured to apply a first gain to the second output signal when the second speaker component is in the first position and to apply a second gain to the second output signal when the second speaker component is in the second position, the second gain exceeding the first gain. (Item 20) Item 19. An augmented reality device comprising the audio reproduction system according to item 18, Left transparent display eyepiece, Right transparent display eyepiece, a left-eye projector optically coupled to the left transparent display eyepiece; a right-eye projector optically coupled to the right transparent display eyepiece; a video and audio processing system coupled to the left-eye projector, the right-eye projector, the first speaker component, and the second speaker component, the video and audio processing system configured to generate virtual video and audio content; The augmented reality device further comprises: (Item 21) A head-wearable device, A left woofer component, A left tweeter component, at least one left sound outlet for the left woofer component and the left tweeter component; A right woofer component; A right tweeter component; at least one right audio outlet for the right woofer component and the right tweeter component; at least one support structure, the at least one support structure for supporting the left woofer component, the left tweeter component, the right woofer component, and the right tweeter component; Head-wearable devices, including Equipped with the head-wearable device is configured for mounting on a head at a mounting position; the at least one support structure is shaped to support the left woofer component, the left tweeter component, the right woofer component, and the right tweeter component such that, when the head-wearable device is in the mounted position on an appropriately sized IEC 60318-7 audio test dummy head, the at least one left audio outlet is within 1.5 centimeters of a center of a left ear canal opening of the IEC 60318-7 audio test dummy head and the at least one right audio outlet is within 1.5 centimeters of a center of a right ear canal opening of the IEC 60318-7 audio test dummy; the head-wearable device includes an air impermeable material including at least a portion of the left and right woofer components, the left and right tweeter components, and the left and right support structures; When the head-wearable device is in the mounting position on the IEC 60318-7 audio test dummy head, where the head-wearable device is appropriately sized relative to the center of the left ear canal opening, the air impermeable portion is less than 80% of a portion of a 4π solid angle centered on the center point of the left ear canal opening that is not covered by the IEC 60318-7 audio test dummy head itself. With respect to the center point of the opening of the right ear canal of the audio test dummy head, the air impermeable portion is not covered by the IEC 60318-7 audio test dummy head itself, for less than 80% of a portion of a 4π solid angle centered on the center point of the opening of the right ear canal; Audio playback system. (Item 22) 22. The sound reproduction system according to item 21, wherein the air impermeable portion is for at least 20% of a portion of a 4π solid angle centered on the center point of the left ear canal opening that is not covered by the IEC 60318-7 audio test dummy head itself, and for the center point of the right ear canal opening of the audio test dummy head, the air impermeable portion is for at least 20% of a portion of a 4π solid angle centered on the center point of the right ear canal opening that is not covered by the IEC 60318-7 audio test dummy head itself. (Item 23) 22. An augmented reality device comprising the audio reproduction system according to item 21, Left transparent display eyepiece, Right transparent display eyepiece, a left-eye projector optically coupled to the left transparent display eyepiece; a right-eye projector optically coupled to the right transparent display eyepiece; a video and audio processing system coupled to the left-eye projector, the right-eye projector, the left woofer component, the left tweeter component, the right woofer component, and the right tweeter component, configured to generate virtual video and audio content; An augmented reality device comprising: [Brief description of the drawings]

[0023] The drawings illustrate the design and utility of preferred embodiments of the present invention, where like elements are referred to by common reference numerals. To further appreciate how the above-described and other advantages and objects of the present invention are obtained, a more particular description of the invention briefly described above will be provided by reference to specific embodiments thereof, which are illustrated in the accompanying drawings. With the understanding that these drawings depict only exemplary embodiments of the invention and therefore are not to be considered as limiting its scope, the present invention will be described and explained with additional specificity and detail through the use of the accompanying drawings. [Figure 1A]FIG. 1A shows a head-mounted (head-wearable) sound reproduction device with ear-clip mounted attachment, with both the woofer and tweeter components located near the ear canal. [Figure 1B] FIG. 1B shows a head-mounted (head-wearable) sound reproduction device with an ear-clip mounted attachment in which the woofer component is close to the ear canal and the tweeter component is further away. [Figure 2A] FIG. 2A shows a head-mounted (head-wearable) sound reproduction device with a head-over-head mounting attachment, with both the woofer and tweeter components near the ear canal. [Figure 2B] FIG. 2B shows a head-mounted (head-wearable) sound reproduction device with a head-over-head mounting attachment in which the woofer component is closer to the ear canal and the tweeter component is further away. [Diagram 3] 3A-3D show encapsulated driver designs for the woofer and tweeter components that may be used in the head-mounted audio reproduction devices shown in FIGS. 1A, 1B, 2A, 2B, 9A, and 9B, including with and without a rear volume and with and without an audio-directing tunnel. [Figure 4] 4A-4D show direct radiating driver designs for the woofer and tweeter components that may be used in the head-mounted sound reproduction devices shown in FIGS. 1A, 1B, 2A, 2B, 9A, and 9B, including designs with and without rear volumes and with and without sound-reflecting surfaces or sound-attenuating diffusers. [Figure 5A] 5A-5C show different configurations of input circuitry for passive, active, and active bi-amp operation that may be included in or used with the head-mounted audio reproduction devices shown in FIGS. 1A, 1B, 2A, 2B, 9A, and 9B. [Figure 5B] 5A-5C show different configurations of input circuitry for passive, active, and active bi-amp operation that may be included in or used with the head-mounted audio reproduction devices shown in FIGS. 1A, 1B, 2A, 2B, 9A, and 9B. [Figure 5C] 5A-5C show different configurations of input circuitry for passive, active, and active bi-amp operation that may be included in or used with the head-mounted audio reproduction devices shown in FIGS. 1A, 1B, 2A, 2B, 9A, and 9B. [Figure 6] 6A-6C show different configurations of the input receiver portion of the input circuitry shown in FIGS. 5B and 5C for analog input, USB input, and wireless input. [Figure 7] 7A-7B show examples of suitable and useful frequency response curves for the high-pass and low-pass filter portions of the input circuits shown in FIGS. 5A, 5B, and 5C. [Figure 8] 8A-8B show a head-mounted (head-wearable) sound reproduction device with a mounting attachment that includes user-adjustable positioning of a tweeter component over a range of distances from the ear canal. [Figure 9A] FIG. 9A shows a head-mounted (head-wearable) augmented reality device incorporating the audio playback device of FIG. 1A. [Figure 9B] FIG. 9B illustrates a head-mounted (head-wearable) augmented reality device that incorporates the audio playback device of FIG. 1B using an alternative form of mounting attachment. [Figure 10] FIG. 10 shows a top cross-sectional view of an audio test dummy head with artificial ears and ear canals, with a woofer located next to each ear. [Figure 11A] FIG. 11A is a cross-sectional view of a first integrated woofer and tweeter component that may be used as a replacement for the woofer and tweeter components used in the sound reproduction devices shown in FIGS. 1A, 2A, and 9A. [Figure 11B] FIG. 11B is a cross-sectional view of a second integrated woofer and tweeter component that may be used as a replacement for the woofer and tweeter components used in the sound reproduction devices shown in FIGS. 1A, 2A, and 9A. [Figure 12A]FIG. 12A is a cross-sectional view of a first pair of adjacent woofer and tweeter components that may be used as a replacement for the woofer and tweeter components used in the sound reproduction devices shown in FIGS. 1A, 1B, 2A, 2B, 9A, and 9B. [Figure 12B] FIG. 12B is a cross-sectional view of a second pair of adjacent woofer and tweeter components that may be used as a replacement for the woofer and tweeter components used in the sound reproduction devices shown in FIGS. 1A, 1B, 2A, 2B, 9A, and 9B. [Figure 13] 13A-13B show a head-mounted (head-wearable) sound reproduction device with a woofer component and two tweeter components (per ear), one of the latter farther from the ear canal than the other, with user-activated controls for switching between the closer and farther tweeter components. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] In the following discussion and associated figures, depictions of both physical devices and electronic components represented by blocks are often both presented within a single figure. In those cases where both are shown within a single figure, the physical devices are presented against the background of a human ear or head to distinguish them from the block diagram depictions of the electronic components.

[0025] The depictions of electronic components should be understood to be "schematic". For example, electronic components shown in schematic form "below" two physical earpieces may actually be implemented in a variety of ways, which may include mounted in or on either earpiece, split between the two earpieces, provided in a small panel on the audio cable, provided as separate controls in a wireless system, any combination of the above, etc. Also, to the extent any distinctions (explicit or implied) are made regarding signal or data processing taking place in a software processor versus a hardware chip, such distinctions are not straightforward to the functionality disclosed and both approaches may be effective.

[0026] Similarly, lines with arrows are used in the figures to represent "audio signal conduits" that convey audio signals within or between electronic or physical components. The audio signal conduits may be implemented in whole or in part in a variety of ways, which may include analog audio cables, digital audio cables, wireless audio signals, traces on a circuit board, function calls in a software process, custom connectors, combinations of the above, etc.

[0027] More generally, throughout this disclosure, various implementation and configuration options for the disclosed devices are presented. The description does not specify in detail all possible permutations of these options, both in terms of the number of options available for a given component and the number of combinations made available by swapping out different options for different components. Rather, due to space constraints, only a representative set of options and combinations are included. However, the devices are not limited to only those permutations disclosed, and many other combinations and permutations are contemplated. It is the intent of the design of this device to allow different options and permutations for components to be combined in different ways to achieve a particular goal or objective.

[0028] 1A shows a head-mounted sound reproduction device 100 including an input circuit block 110, a left earphone 120, a right earphone 130, and audio signal conduits 112, 114, 116, 118, including a left woofer audio signal conduit 112, a left tweeter audio signal conduit 114, a right woofer audio signal conduit 116, and a right tweeter audio signal conduit 118. In addition, an external audio source 102, which may not be part of the device 100, provides stereo audio signals that are output via a left channel audio signal conduit 104 and a right channel audio signal conduit 106 as inputs to the head-mounted sound reproduction device 100. The external audio source 102 may be any of several types of devices used to generate and / or reproduce audio, such as, for example, a smartphone, a music player, a gaming console, a tablet, a computer, a virtual reality device, an augmented or mixed reality device, etc.

[0029] The input circuit block 110 can be internally configured in a variety of ways (as discussed further herein below). The function of the input circuit is to receive stereo audio signals from the external sound source 102 via left channel audio signal conduit 104 and right channel audio signal conduit 106, and couple signals derived from the stereo audio signals to audio signal conduits 112, 114, 116, 118 which couple the signals to left earphone 120 and right earphone 130.

[0030] Looking more closely at the left earphone 120, it comprises a woofer component 122 with sound outlet 122a, a tweeter component 124 with sound outlet 124a, and a left ear clip mounting attachment 126, a portion 126a of which is shown behind the left ear 27. The woofer component 122 and the tweeter component 124 are mounted to the mounting attachment 126 which is positioned such that the sound outlet 122a for the woofer component 122 and the sound outlet 124a for the tweeter component 124 are both within about one centimeter of the center of the user's ear canal opening 128. A variety of different options and construction approaches for implementing the woofer component 122 and the tweeter component 124 may be effective in the context of the device, some of which are presented in the following figures.

[0031] Referring again to the two audio signal conduits 112 and 114 that convey the audio signal from the input circuit block 110 to the left earphone 120, it can be seen that each conduit conveys its audio signal to a different internal component within the left earphone 120. Specifically, the audio signal conduit 112 conveys the audio signal to the woofer component 122, and the audio signal conduit 114 conveys the audio signal to the tweeter component 124. The audio signals on the audio signal conduits 112 and 114 need not be essentially different, but there are options, shown in subsequent figures, for generating different versions of these audio signals that are optimized for their respective woofer and tweeter destinations. The right side of FIG. 1A, including the right earphone 130 and the audio conduits 116 and 118, is substantially identical to that just described, except for the other ear. In the right side of FIG. 1A, elements corresponding to the elements on the left side of FIG. 1A are labeled with reference numbers that differ from those of the corresponding left side elements by replacing the number 2 with the number 3 in the second digit of each reference number. The right woofer signal conduit 116 is coupled to a right woofer component 132, which includes an audio outlet 132a. The right tweeter signal conduit 118 is coupled to a right tweeter component 134, which includes an audio outlet 134a. The right ear clip mounted attachment 136 includes a portion 136a that extends behind the right ear 129. Further details will not be provided.

[0032] 1B shows a head-mounted sound reproduction device 150 including an input circuit block 160, a left earphone 170, a right earphone 180, and audio signal conduits 162, 164, 166, 168, including a left woofer audio signal conduit 162, a left tweeter audio signal conduit 164, a right woofer audio signal conduit 166, and a right tweeter audio signal conduit 168. In addition, an external sound source 102 that is not part of the device provides stereo audio signals as inputs through a left channel audio signal conduit 154 and a right channel audio signal conduit 156. As significant aspects of the device 150 are substantially similar to the device 100 of FIG. 1A, redundant discussion will not be repeated. An aspect of the device 150 that is not substantially similar to the device 100 is the positioning of the tweeter component.

[0033] Insofar as the left earphone 170 and the right earphone 180 are substantially mirror images of one another, for the sake of brevity, only the left earphone 170 will be described in detail. On the right side of FIG. 1B, elements corresponding to those on the left side of FIG. 1B are labeled with reference numbers that differ from those of the corresponding left side elements by replacing the number 7 with the number 8 in the second digit of each reference number. Referring now to the left earphone 170, the tweeter component 174 and its sound outlet 174a are now located significantly further from the user's ear canal than the woofer component 172 and its sound outlet 172a. The ear clip mounting attachment 176 is similar to the ear clip 126, but in the device 150, the mounting attachment 176 has an extension 178 that positions the tweeter component 174 farther away, now about 4 cm from the opening of the user's ear canal. The mounting attachment 176 also includes a portion 176a that rests behind the left ear 127. The right side of FIG. 1B also shows an equivalent structure for right earbud 180, in which mounting attachment 186 now has an extension 188 that similarly positions tweeter component 184 farther away from the right ear canal opening.

[0034] 2A shows a head-mounted sound reproduction device 200 including an input circuit block 210, a left earphone 220, a right earphone 230, audio signal conduits 212, 214, 216, 218, including a left woofer audio signal conduit 212, a left tweeter audio signal conduit 214, a right woofer audio signal conduit 216, and a right tweeter audio signal conduit 218, and a head-over-head mounting attachment 240. The head-mounted reproduction device 200 is shown in a mounting position on the head 241, where the device 200 is appropriately sized. In addition, an external sound source 102, which is not part of the device, provides stereo audio signals as inputs via a left channel signal conduit 204 and a right channel signal conduit 206. To the extent that the left earphone 220 and the right earphone 230 are substantially mirror images of each other, for simplicity, only the left earphone 220 will be described in detail. On the right side of FIG. 2A, elements corresponding to elements on the left side of FIG. 2A are labeled with reference numbers that differ from those of the corresponding left side elements by replacing the number 2 with the number 3 in the second digit of each reference number. Referring to the left side of FIG. 2A, the left earphone 220 includes a left woofer component 222 including an audio outlet 222a and a right tweeter component 224 including an audio outlet 224a. As significant aspects of the device 200 are substantially similar to the device 100 of FIG. 1A, redundant discussion will not be repeated. An aspect of the device 200 that is not substantially similar to the device 100 is in the form of a mounting attachment 240.

[0035] Unlike the left and right earbuds 120, 130 of FIG. 1A, which had their own ear clip mounting attachments 126, 136, respectively, the left and right earbuds 220, 230 of FIG. 2A do not have ear clip mounting attachments as part of the earbuds 220, 230. Rather, there is an overall head-spanning mounting attachment 240 that reaches up to the left and right earbuds 220, 230 on each side and spans across the head. A left side 240a of this mounting attachment can be seen on the left side of FIG. 2A, and a right side 240b of the mounting attachment can be seen on the right side of FIG. 2A. Except for this difference in the mounting attachments, and the fact that the woofer and tweeter components are mounted on this head-spanning mounting attachment rather than on an ear clip, other aspects of the device 200 shown in FIG. 2A (including the placement of the woofer and tweeter components) are substantially similar to the device 100 shown in FIG. 1A.

[0036] FIG. 2B shows a head-mounted sound reproduction device 250 including an input circuit block 260, a left earphone 270, a right earphone 280, audio signal conduits 262, 264, 266, 268, including a left woofer audio signal conduit 262, a left tweeter audio signal conduit 264, a right woofer audio signal conduit 266, and a right tweeter audio signal conduit 268, and a head-over-head mounting attachment 290. The head-mounted reproduction device 250 is shown in a mounting position on the head 241, where the device 250 is appropriately sized. Insofar as the left earphone 270 and the right earphone 280 are substantially mirror images of each other, for the sake of simplicity, only the left earphone 270 will be described in detail. On the right side of FIG. 2B, elements corresponding to the elements on the left side of FIG. 2B are labeled with reference numbers that differ from those of the corresponding left side elements by replacing the number 7 with the number 8 in the second digit of each reference number. 2B, the left earphone includes a left woofer component 272, which includes an audio outlet 272a, and a left tweeter component 274, which includes an audio outlet 274a. An extension arm 278 supports the tweeter component 274 in a position such that the audio outlet 274a of the tweeter 274 is preferably spaced 1 / 2 to 6 centimeters, and more preferably 2 to 6 centimeters, from the audio outlet 272a of the woofer 272. As shown, the tweeter audio outlet 274a is positioned closer to the front of the user's head compared to the woofer audio outlet 272a. When the device 250 is properly mounted on a user's head or an audio dummy test head IEC 60318-7 (the device 250 may be sold in multiple sizes to fit different sized heads so that the device 250 is appropriately sized), the sound outlet 272a of the woofer component 272 will preferably be within 1.5 centimeters, more preferably within 1.2 centimeters, of the center of the opening of the ear canal, and the sound outlet 274a of the tweeter component 274 will be spaced 1 / 2 to 7.5 centimeters from the center of the opening of the ear canal. However, preferably the tweeter sound outlet 274a is within 6 centimeters of the user's ear canal.Placing the tweeter sound outlet 274a at least 1 / 2 centimeter away from the user's ear canal helps to increase the realism of the audio spatialization of the sound. The tweeter sound outlet 274a is preferably spaced away from the user's ear canal towards the front of the user's head. The realism increases to a significant perceptible degree when the distance of the tweeter sound outlet 274a to the user's ear canal is further increased to 4 centimeters, and further increases perceptibly when said distance is increased to 6 centimeters, but typically does not increase perceptibly when the distance is increased beyond 6 centimeters. Such realism of the virtual sound is highly beneficial for augmented reality and mixed reality applications, which will be further described herein below. However, there is a trade-off in that increasing the distance between the tweeter sound outlet 274a and the user's ear canal requires the volume of the audio emitted by the tweeter to be increased, increasing the distance within which nearby persons will hear the sound, thereby potentially violating the user's privacy and causing inconvenience to such nearby persons. Thus, according to an embodiment, it may be desirable to locate the tweeter audio outlet 274a within 4 centimeters of the ear canal when the device 250 is properly mounted on the user's head or on an audio dummy test head IEC60318-7 (where the device 250 is appropriately sized since the device 250 may be sold in multiple sizes to fit different sized heads). An external sound source 102, which may not be part of the device 250, provides stereo audio signals (254, 256) as input. As significant aspects of the device 250 are substantially similar to the device 150 of FIG. 1B, redundant discussion will not be repeated. The aspect of the device 250 that is not substantially similar to the device 150 is the form factor of the mounting attachment 290.

[0037] Unlike the left and right earbuds of FIG. 1B, which had their own ear clip mounting attachments 176, 186, respectively, the left and right earbuds 270, 280 of FIG. 2B do not have ear clip mounting attachments as part of the earbuds 270, 280. Rather, there is a full head spanning mounting attachment 290 that reaches up to the left and right earbuds 270, 280 on each side and spans across the head. A left side 290a of the mounting attachment 290 can be seen on the left side of FIG. 2B, and a right side 290b of the mounting attachment 290 can be seen on the right side. Except for this difference in the mounting attachment, and the fact that the woofer 272, 282 and tweeter 274, 284 components are mounted on this head-spanning mounting attachment 290 rather than on an ear clip, the remainder of FIG. 2B (including the location of the woofer 272, 282 and tweeter components 274, 284, and mounting attachment extensions 278 and 288) is substantially similar to that shown in FIG. 1B and described above.

[0038] 3A, 3B, 3C, 3D, and 4A, 4B, 4C, 4D show different design options for implementing the woofer and tweeter components included in the head-mounted sound reproduction device described herein. The depicted design options are not intended to be limiting, but rather to show some approaches for how the woofer and tweeter components can be implemented using elements such as dynamic drivers, rear volumes, front volumes, tunnels and funnels, and reflectors and diffusers. Other approaches and designs can also be effective for implementing the woofer and tweeter components of the device. For example, it is possible to take separate sound outlets from the woofer and tweeter components and merge them into a shared chamber or sound tunnel with a single sound outlet. In such cases of a shared sound outlet, the woofer and tweeter sound outlets would be considered to be co-located at the location of the shared sound outlet. An example of a co-located woofer and tweeter sound outlet is shown in FIGS. 11A and 11B.

[0039] In the following discussion, the speaker designs are for the most part "woofer-tweeter agnostic," meaning that any given design (with appropriate choices of size, weight, shape, etc.) may be used to implement either a woofer or tweeter component (with some exceptions noted). Thus, the term "speaker component" in the following discussion is used as a general term to mean either a woofer component or a tweeter component. In each of the examples below, the speaker driver element of the speaker component is illustrated as a type of driver commonly referred to as a dynamic driver. However, other types of speaker drivers, such as piezoelectric drivers, balanced armature drivers, etc., may also be used. The use of dynamic drivers in the following figures is illustrative only and is not intended to be limiting.

[0040] 3A depicts a top-down cross-sectional view of a speaker component 300, including a speaker driver 302, a rear enclosure 304, and a front enclosure 310. The rear enclosure 304 creates a "rear volume" or chamber 306 that is used to enclose air and improve the performance of the sound reproduction hardware. The rear enclosure 304 has one or more ports 308, which are openings that allow some movement of air. The front enclosure 310 also encloses air and creates a "front volume" or chamber 312. However, in this case, sound is directed (e.g., toward the user's ear canal opening) through an audio outlet 314, shown as an opening in the surface of the front enclosure 310.

[0041] FIG. 3B depicts a top-down cross-sectional view of a speaker component 320 that is substantially similar to the speaker component 300 of FIG. 3A, except that the rear enclosure 304 seen in FIG. 3A is omitted in the speaker component 320 of FIG. 3B.

[0042] FIG. 3C depicts a top-down cross-sectional view of speaker component 340, including speaker driver 342, rear enclosure 344, front enclosure 350, and acoustic tunnel 354. Rear enclosure 344 of FIG. 3C is substantially similar to rear enclosure 304 of FIG. 3A. Front enclosure 350 is largely similar to front enclosure 310 of FIG. 3A, except that the latter has an opening that forms sound outlet 314, and the former connects to sound tunnel 354 and has an opening at its end that forms sound outlet 356. Front enclosure 350 encloses front volume 352. Sound tunnel 354 in the schematic is illustrated as being centered on the speaker driver and having an equal width along its entire length, although in other cases the specific taper or shape of the sound tunnel may vary significantly, as many different forms and shapes of sound tunnels may be effective for directing sound.

[0043] FIG. 3D depicts a top-down cross-sectional view of a speaker component 360 similar to the speaker component 340 of FIG. 3C, except that the rear enclosure 344 seen in FIG. 3C is omitted in the speaker component 360 of FIG. 3D. The speaker component 360 includes a driver 362 that faces into a front enclosure 364. An audio tunnel 368 is offset with respect to a common axis of the drivers 362, 364 and extends at an angle with respect to said common axis. Alternatively, the audio tunnel 368 may also be tapered. Audio tunnels of different forms and shapes may be effective to direct sound out of the front enclosure 364.

[0044] FIG. 4A depicts a top-down cross-sectional view of a speaker component 400, including a direct radiating speaker driver 402 and a rear enclosure 404. The rear enclosure 404 of FIG. 4A is substantially similar to the rear enclosure 304 of FIG. 3A. The direct radiating speaker driver 402 disperses sound directly from the surface of the diaphragm into the air (notwithstanding any "acoustically transparent" material that may cover the speaker for protection or aesthetics). Thus, the direct radiating driver may be said to have a sound outlet 410 that is roughly coextensive with the circumference of the surface of the diaphragm.

[0045] Figure 4B depicts a top-down cross-sectional view of a speaker component 420 that is substantially similar to the speaker component 400 of Figure 4A, except that the rear enclosure 404 seen in Figure 4A is omitted in the speaker component 420 of Figure 4B. This configuration is not recommended for a woofer component.

[0046] FIG. 4C depicts a top-down cross-sectional view of a speaker component 440, including a direct-radiating speaker driver 442, a rear enclosure 444, an audio-reflecting surface 450, and an audio-attenuating diffuser 452. The rear enclosure 444 of FIG. 4C is substantially similar to the rear enclosure 304 of FIG. 3A. In this example, the audio-reflecting surface 450 is shown in cross-section like the rest of the elements, so it cannot be clearly seen that it is "cupping" the audio to go in a particular direction (as would be readily apparent if FIG. 4C were drawn in three dimensions). The audio outlet 454 for the speaker component 440 is located in a position that reflects this "cupping", i.e., it is located where the speaker driver 442 and attached audio-reflecting surface 450 would form a kind of "opening" if viewed in three dimensions. In addition, a portion of the sound-reflecting surface 450 is used to mount an optional sound-attenuating diffuser 452 which slightly randomizes the directionality of the output sound waves (to make the sound less "fragile" and more "diffuse").

[0047] Figure 4D depicts a top-down cross-sectional view of a speaker component 460 that is substantially similar to the speaker component 440 of Figure 4C, except that the rear enclosure 444 seen in Figure 4C is omitted in the speaker component 460 of Figure 4D. This configuration is not recommended for a woofer component.

[0048] Figure 5A is a schematic diagram showing an internal implementation of an input circuit block 500, which may be used to implement any of the input circuit blocks 110, 160, 210, 260 shown in Figures 1A-2B. Input circuit block 500 is a "passive" input circuit block, meaning that it does not have its own power source, but rather relies on receiving an audio signal that is "speaker-level" (i.e., strong enough to drive a speaker driver).

[0049] 1A-2B, external audio source 102 provides stereo audio signals via left channel signal conduit 104 and right channel audio signal conduit 106 to input circuit block 500 where the signals are received by input plug 510 (which can be any type of connector, with typical forms being a standard 3.5 mm plug or a ¼ inch plug). From input plug 510, audio signal conduit 512a conveys the left channel of the audio signal to both left tweeter audio signal conduit 520a and left woofer audio signal conduit 522a.

[0050] On the way from audio signal conduit 512a to left tweeter audio signal conduit 520a, the audio signal may optionally pass through a passive high pass filter 516a. Similarly, an optional passive low pass filter 514a can be interposed between left audio signal conduit 512a and left woofer audio signal conduit 522a. The passive low pass filter 514a removes high frequencies from the audio signal, making the woofer component operate more effectively. The passive high pass filter 516a removes low frequencies from the audio signal, making the tweeter component operate more effectively. The implementation of the right side of input circuit block 500 (with elements 512b, 514b, 516b, 520b, 522b) is substantially similar to that of the left side. Right side elements that correspond in function to their left side counterparts have the suffix b in their reference numbers instead of the suffix a in their reference numbers.

[0051] FIG. 5B is a schematic diagram showing an internal implementation of an input circuit block 530 that may be used to implement any of the input circuit blocks 110, 160, 210, 260 shown in FIGS. 1A-2B. For simplicity, the following description of the input circuit focuses on the left side components, with the understanding that there are corresponding right side components that are substantially similar in structure and function to the left side components. The corresponding left and right side components are labeled with reference numbers that differ only in that the left side reference numbers have a letter "a" suffix and the right side components have a letter "b" suffix. The input circuit 530 includes an input receiver 540 that is coupled to a left channel amplifier 544-a through a left channel signal conduit 542-a and to a right channel amplifier 544-b through a right channel signal path 542-b. An output signal bus 546-a of the left channel amplifier 544-a is coupled to an optional passive low pass filter 548-a and a passive high pass filter 549-a. Passive low pass filter 548 outputs to a left woofer audio signal conduit 522a, and passive high pass filter 516-a outputs to a left tweeter audio signal conduit 520-a.

[0052] Input circuit block 530 is an "active" input circuit block, meaning that it has a power source 538 (which can be either internal, such as a rechargeable battery, or external from some other device). In input circuit 530, power 538 delivers to active elements that consume power, which would include at least left and right channel amplifiers 544a and 544b, and possibly an input receiver block 540.

[0053] In FIG. 5B, as seen previously in FIGS. 1A-2B, an external sound source 102 provides stereo audio signals via left channel audio signal conduit 104 and right channel audio signal conduit 106 to an input circuit block 530 where the signals are received by an input receiver block 540. In an active system, the input receiver block 540 may be implemented passively in a manner similar to the input plug 510 of FIG. 5A. More typically, in an active system, the input receiver 540 will receive power from a power source 538, such as may be implemented internally as shown in subsequent figures. From the input receiver 540, an audio signal conduit 542a conveys the left channel of the audio signal to a left amplifier channel 544a. From there, an audio conduit 546a conveys the left channel of the audio signal to both a left tweeter audio conduit 550a and a left woofer audio conduit 552a.

[0054] On the way from audio signal conduit 542a to output audio conduits 550a and 552a, the audio signal may optionally pass through a passive low pass filter 548a on the way to left woofer audio conduit 552a, and a passive high pass filter 549a on the way to left tweeter audio conduit 550a. The implementation of these filters (548a, 549a) is substantially similar to the filters (514a, 516a) shown in FIG. 5A.

[0055] FIG. 5C is a schematic diagram showing an internal implementation of an input circuit block 560 that can be used to implement any of the input circuit blocks 110, 160, 210, 260 shown in FIGS. 1A-2B. For simplicity, the following description of the input circuit 560 focuses on the left-side components, with the understanding that there are corresponding right-side components that are substantially similar in structure and function to the left-side components. The corresponding left and right-side components are labeled with reference numbers that differ only in that the left-side reference numbers have a letter "a" suffix and the right-side components have a letter "b" suffix. The input circuit block 560 is an "active bi-amp connected" input circuit block, meaning that it has a power source 568 (which can either be internal, such as a rechargeable battery, or external from some other device). In FIG. 5C, the power 568 delivers to power-consuming elements, which in this active bi-amp configuration can include all of the other electronic components in the input circuit block 560.

[0056] The benefit of using an active bi-amp configuration is that it not only more reliably produces better results (because the amplifiers are selected to match the speakers), but also allows for more precise "signal processing" of the separate woofer and tweeter signals, since they are split and processed "before" the amplifiers while still in the "digital domain," in a "bi-amped" scenario. This improved processing can often result in improved audio quality. Note that the specific ordering of components shown in FIG. 5C (i.e., what comes after what is in the "signal chain") represents one effective option, but other orderings may be equally or even more effective for particular purposes.

[0057] In FIG. 5C, as seen above in FIGS. 1A-2B, an external audio source 102 provides stereo audio signals via left channel audio signal conduit 104 and right channel audio signal conduit 106 to an input circuit block 560 where the signals are received by an input receiver 570. In an active bi-amp configuration such as that of input circuit 560, input receiver 570 is typically implemented as shown in subsequent FIGS. 6A-6C. From input receiver 570, left audio signal conduit 572a conveys the left channel of the audio signal to both left woofer amplifier 586a and left tweeter amplifier 588a. From there, the output of left woofer amplifier 586a drives (directly or indirectly) audio signal conduit 592a that goes to the left woofer, and the output of left tweeter amplifier 588a drives (directly or indirectly) audio signal conduit 590a that goes to the left tweeter.

[0058] On the way from audio signal conduit 572a to the respective inputs of left woofer amplifier 586a and left tweeter amplifier 588a, the audio signal may optionally pass through an active low pass filter 574a on the way to the left woofer amplifier 586a and may optionally pass through an active high pass filter 576a on the way to the left tweeter amplifier 588a. The implementation of active low pass filter 574a and active high pass filter 576a will not be identical to that seen in the previous figures because in FIG. 5C the filters are active rather than passive, i.e., powered by power 568 and implemented in the digital domain as digital signal processing (DSP) algorithms. Regardless of their implementation, the primary goal of including the optional filters 514, 516, 548, 549, 574, 576 shown in FIGS. 5A-5C is to adapt filter response curves to make the woofers and tweeters more effective, with several example filter response curves shown in the following figures.

[0059] Also, on the way from the audio signal conduit 572a to the input of the left woofer amplifier 586a, the audio signal may pass through an audio delay block 580a, which optionally delays the time of the woofer signal. This delay is useful for configurations where the tweeter component is significantly farther (i.e., up to several centimeters) from the opening of the user's ear canal than the woofer component. In such cases, considering the speed of sound propagation in air (approximately 335 meters per second), the difference in distance may be large enough that the sound waves from the woofer reach the ear significantly sooner than the corresponding sound waves from the tweeter. The resulting mix, which may be referred to as "unaligned" or "out of phase", may sound "mixed" to the average listener. The purpose of the audio delay 580a is to compensate for this arrival time difference so that the now delayed woofer sound arrives at the ear canal at the same time (as close as possible) as the corresponding tweeter sound, and the sound remains clear and pure.

[0060] Finally, a further optional optimization, depicted in FIG. 5C, is the use of "smart" amplification for two of the four channels (the two woofer amplifiers 586a and 586b). In "smart" amplification, an amplifier channel monitors aspects of the speaker driver it is driving, such as its excursion (i.e., position within its range), temperature, etc., so that the amplifier can drive the driver to the limits of its performance (but never beyond it to cause audible distortion). The left woofer amplifier 586a receives a speaker monitor signal conduit 594a, indicating that this amplifier channel is a "smart" amplifier that monitors its attached speaker driver. Similarly, the right woofer amplifier 586b receives a speaker monitor signal conduit 594b.

[0061] FIG. 6A is a schematic diagram illustrating an input circuit block 600 including an input receiver block 610 that may be used to implement any one of the input receiver blocks 540, 570 of FIGS. 5B-5C. The input receiver 610 is an "active" block, meaning that it draws power to activate its components from a power source, such as the power source 538 of FIG. 5B or the power source 568 of FIG. 5C. An external audio source 102 provides stereo audio signals to the input circuit block 600 via a left channel audio signal conduit 104 and a right channel audio signal conduit 106, where the signals are received by the input receiver 610, and more specifically, by an analog plug 612 (which may be any type of connector, with typical forms being a standard 3.5 mm plug or a ¼ inch plug). From the analog plug 612, a left audio signal conduit 614 and a right audio signal conduit 616 convey the left and right audio signals to a digital-to-analog converter 618 that converts the analog audio signals to digital audio signals. From there, the left and right audio signals are propagated out via left digital output audio signal conduit 620 and right digital output audio signal conduit 622 to other portions of input circuit 600 .

[0062] FIG. 6B is a schematic diagram illustrating an input circuit block 630 including an input receiver block 640 that may be used to implement any one of the input receiver blocks 540, 570 of FIGS. 5B-5C. The input receiver 640 is an "active" block, meaning that it draws power to activate its components from a power source, such as the power source 538 of FIG. 5B or the power source 568 of FIG. 5C. The input receiver 640 implements a Universal Serial Bus (USB) interface and includes a USB plug 642 and a USB processing block 648. An external audio source 632 provides a digital stereo audio signal 634 to the USB processing block 648 via the USB plug 642. The USB interface may conform to one of several USB variants, including the latest USB-C. From the USB plug 642, an audio digital signal encoding the left and right audio channels is coupled to the USB processing block 648 via a digital signal conduit 644. The USB processing block 648 may include an audio decoder. The USB processing block 648 generates left and right channel audio signals that are output to the remainder of the input circuitry 630 via a left audio signal output 650 and a right audio signal output 652, respectively.

[0063] FIG. 6C is a schematic diagram showing an input circuit block 670 including an input receiver block 680 that can be used to implement any one of the input receiver blocks 540, 570 of FIGS. 5B-5C. The input receiver 680 is an "active" block, meaning that it draws power to activate its components from a power source, such as the power source 538 of FIG. 5B or the power source 568 of FIG. 5C. An external audio source 672 provides stereo audio signals via signal conduits 674 (in this case a wireless channel) to the input circuit block 670, where the signals are received by the input receiver 680, more specifically, by a wireless receiver block 682 (which can be any type of wireless receiver, a typical form being a Bluetooth chip or an NFMI chip). From the wireless receiver 682, the left and right audio signals are propagated out from the input receiver 680 to other parts of the input circuit 670 via audio conduits 690 and 692.

[0064] Figure 7A shows a frequency response chart 700 with frequency response curves 706-712 that may be effective as a high pass filter applied to an audio signal used to drive a tweeter component, as is done by optional high pass filter blocks 516a, 516b, 549a, 549b, 576a, 576b shown in Figures 5A-5C. The frequency response curves 706-712 are shown across a chart background where the vertical axis 702 is in decibels and indicates relative volume levels ranging from +20 decibels to -50 decibels, and the horizontal axis 704 is in Hertz and indicates frequency ranging from 20 Hz to 20 KHz. From this chart 700, the high pass filter behavior can be easily seen, with frequencies below 1KHz 706-708 being attenuated by over 50 decibels, then there is a gradual increase in volume for frequencies 708-710 from 1.0KHz to 1.4KHz, while frequencies 710-712 above 1.4KHz are allowed to pass unaffected. This frequency curve, or others using a similar holistic approach, can be an effective tool to help tweeter components function effectively and optimally within a device.

[0065] FIG. 7B shows a frequency response chart 750 with frequency response curves 756-766 that may be effective as a low pass filter applied to an audio signal going to a woofer component, as done by optional low pass filter blocks 514a, 514b, 548a, 548b, 574a, 574b shown in FIGS. 5A-5C. The chart 750 has a vertical axis 752 showing relative signal levels ranging from +20 dB to -50 dB, and a horizontal axis 754 showing frequencies ranging from 20 Hz to 20 KHz. From this chart 750, the behavior of the low pass filter can be easily seen, starting with a significant bump 758 in the bass region, boosting the bass performance of the woofer component by up to more than 20 dB. The response curves 756-766 slope down until there is no boost or cut at 100 Hz 760. From 100Hz to 1Khz 760-762, there is no boost or cut in frequencies. Then there is a gradual decrease in volume for frequencies from 1.0KHz to 1.4KHz 762-764, and frequencies above 1.4KHz have an attenuation of greater than -50dB 764-766. This frequency curve 756-766, or others using a similar holistic approach, can be an effective tool to help woofer components function effectively and optimally within a device.

[0066] The low-pass filters 514a, 514b, 548a, 548b, 574a, 574b and the high-pass filters 516a, 516b, 549a, 549b, 576a, 576b work in a low-high pair, together forming a crossover filter. According to the frequency response shown in Figs. 7A-7B, the crossover frequency is about 1,250 Hz. More generally, the crossover filters can be appropriately selected based on the frequency response of the woofer and tweeter components. According to Fig. 7B, a limited subrange of frequencies 756-758 extending from about 20 Hz to a frequency substantially below the crossover frequency (e.g., 60 Hz) is given a higher gain compared to other frequencies in the range below the crossover frequency. More generally, at least some frequency components (bands) below 100 Hz are amplified substantially more (e.g., at least 10 dB more) compared to other frequency components (bands) below the crossover frequency. This helps provide a powerful low-cost bass component (e.g., for sounds originating from virtual objects) despite the fact that the woofer sound outlets described herein are not intentionally designed to be sealingly engaged within the user's ear canal so as not to interfere with the hearing of ambient sounds (e.g., from real-world sound sources).

[0067] 8A-8B show a head-mounted sound reproduction device 800 including an input circuit block 810, a left earphone 820, a right earphone 830, and audio signal conduits 812, 814, 816, 818. In addition, an external audio source 802 that is not part of the device provides stereo audio signals (804, 806) as input. The external audio source 802 is coupled to the input circuit 810 via a left audio signal conduit 804 and a right audio signal conduit 806. For simplicity, the description is given mainly with reference to the left earphone 820, with it being understood that the right earphone 830 has a substantially similar structure and function to the left earphone. The reference numbers of the elements of the right earphone 830 differ from those of the left earphone by substituting the number 3 for the number 2 in the second digit. The left woofer signal conduit 812 couples the input circuit 810 to a woofer component 822. (There is a corresponding right woofer signal conduit 816.) A left tweeter signal conduit 814 couples the input circuit 810 to a left tweeter component 824. (There is a corresponding right tweeter signal conduit 818.) The left woofer component 822 includes an audio outlet 822a that is positioned within 1.5 centimeters, preferably within 1.2 centimeters, of the center of the opening of the ear canal when the head-mounted playback device 800 is properly mounted on the user's head, taken as represented by an IEC 60318-7 audio test dummy head (it should be understood that the device may be provided in multiple sizes) where the head-wearable device is appropriately sized. The close proximity of the audio outlet 822a of the woofer component combined with the low frequency excess boost, represented for example by the portion 756-758 of the low pass filter frequency response shown in FIG. 7B, produces a powerful and effective bass sound, despite the fact that the audio outlet 822a is not sealingly engaged within the ear canal (as is the case with some earphones). Thus, a user can enjoy strong, effective bass sound without infringing on the user's ability to hear environmental sounds. The ability to hear both environmental sounds and sounds output through a head-mounted sound reproduction device is highly beneficial for mixed or augmented reality devices.

[0068] The left tweeter component 824 is slidably engaged on the left tweeter support rail 828. The device 800 allows the user to manually change the position of the tweeter components 824 and 834. The device 800 is initially shown in FIG. 8A with the tweeter components 824 and 834 located near the ear canal opening of the user. In FIG. 8B, the device 800 is shown in another state in which the tweeter components 824 and 834 have been moved further away from the ear canal opening of the user. Recall that in FIGS. 1A and 1B, two different devices 100, 150 are presented with ear clip mounted attachments 126, 136, 176, 178, 186, 188, respectively, that hold the woofer and tweeter in a fixed position, with the tweeter components 124, 134 located near the ear canal opening and in FIG. 1B, the tweeter components 174, 184 located further away.

[0069] In the case of the device 800 shown in Figs. 8A-8B, the user has the option to vary the tweeter position "on the fly" by manually sliding the tweeter components (824, 834) along their respective tweeter support rails 828, 838. The length of these tweeter support rails 828 and 838 provides a range of distance options for placing the tweeter components, with the range currently considered being 0-4 centimeters from the ear canal opening. This allows the user to make slight physical adjustments that reflect significant audio differences. A closer distance provides more privacy with less leakage or "sound leakage", but with a less than maximal "sound stage" due to the proximity of the tweeter components to the ear. A farther distance provides less privacy with more leakage or "sound leakage", but at the same time the "sound stage" is extended due to the greater distance of the tweeter components, and unlike floor or wall mounted speakers, the sound remains "pure" and free of ambient ambience. The perceptual implications from this latter combination of results are previously unknown and unexpected, yet extremely fascinating.

[0070] To more precisely envision the sliding tweeter components 824 and 834 and the tweeter support rails 828 and 838 along which they slide, one can envision a typical slider-in-rail configuration in which the tweeters are mounted on an enlarged flange that sits "locked" within the partially enclosed channel provided by the tweeter support rail. With the light touch of a finger, a user can easily slide the tweeter component forward or backward within the channel. The tweeter then stops when it reaches the near or far end of the channel, and remains there until it is pushed back in the opposite direction. In this way, with a simple touch, a user can access a variety of tweeter placements and use them to access a range of different types of listening experiences.

[0071] In an optional (but beneficial) extension, the device 800 further comprises left and right sensor components 826b, 836b and their respective sensor targets 824b, 834b. The sensor components 826b and 836b are attached to ear clip mounted attachments 826 and 836, which remain fixed in place. The sensor targets 824b and 834b are mounted on the tweeter components 824, 834, which move whenever the tweeter components 824, 834 move. The sensor components continuously measure the distance to their respective sensor targets and report that information back to the input circuit block 810 via information conduits 826c and 836c. The requirement for this sensing is to be accurate to within approximately one millimeter, or better if possible, which can be accomplished by multiple types of proximity sensing devices, such as optical distance sensors that detect reflective surfaces or capacitive sensors that target conductive materials. The implementation of sensor targets 824b and 834b follows the implementation of sensor components 826b and 836b. Potentiometers or other types of position sensors may also be used.

[0072] Within the input circuit block 810, the left tweeter distance is received by processing blocks 811 and 813, and the right tweeter distance is received by processing blocks 815 and 817. Considering only the left side (the right side is substantially similar), processing block 811 is an audio delay similar in role and function to audio delay 580a in FIG. 5C. Recall that audio delay 580a can then be optionally introduced into the woofer signal chain to correct for sound wave arrival time differences that would otherwise occur when the tweeter is farther from the ear canal than the woofer. In device 800, the "delay time" parameter of audio delay 811 is varied according to the distance report from left sensor 826b. This mapping is programmed so that the time amount compensation is always correct regardless of the tweeter's position. The currently preferred "delay times" range from 0 microseconds when the tweeter sound outlet is co-located with the woofer sound outlet (as seen in FIG. 8A), to a maximum of approximately 100 microseconds when the tweeter is fully extended (as seen in FIG. 8B).

[0073] In addition to the real-time delay control, the input circuit 810 includes a processing block 813 which is a volume (gain) control, a standard audio processing feature, applied at the location in the tweeter signal chain occupied by processing block 582a in FIG. 5C in this case. This processing block 813 provides an automatic volume (gain) adjustment based on ongoing reporting of distance to compensate for the tweeter moving closer to or farther from the ear canal. This ensures that the perceived tweeter volume will remain constant as it is pushed back and forth by the user. Standard "distance vs. loudness" calculations can be used to determine the mapping between volume and speaker location. The currently preferred "volume adjustment" ranges from 0 dB when the tweeter sound outlet is co-located with the woofer sound outlet (as seen in FIG. 8A) to a maximum of about 15 dB when the tweeter is fully extended (as seen in FIG. 8B).

[0074] With the (optional) real-time compensation processing described above in the time and volume domains, the listening benefits obtained from moving the tweeter to different positions can be enjoyed without loss of audio fidelity.

[0075] Alternative mechanisms can be used in place of the tweeter support rails 828, 838 to allow for variation in the position of the tweeter component relative to the user's ear canal opening. For example, the tweeter component could be supported on the end of a swing arm, with a pivot point on the head-over-head mounting attachment.

[0076] FIG. 9A illustrates a head-mounted augmented reality device 900. Referring to FIG. 9A, an eyewear frame, including a left portion 924-a and a right portion 924-b, supports a left transparent display eyepiece 926-a and a right transparent display eyepiece 926-b. A left eye projector 936-a and a right eye projector 936-b are optically coupled to the left and right transparent display eyepieces 926-a, 926-b, respectively. The left and right transparent display eyepieces may each include, for example, one or more transparent waveguide display surfaces. Although shown in block diagram form, the left and right eye projectors 936-a, 936-b are suitably mounted on the eyewear frames 924-a, 924-b. The transparent display eyepieces 926-a, 926-b include waveguides with optical features (e.g., surface relief diffractive optical elements formed in a surface coating) for in-coupling, distributing, and out-coupling the image-like modulated light generated by the eye projectors 936-a, 936-b and directing such image-like modulated light to the user's eye. The in-coupling optical features serve to deflect the image-like modulated light incident on each waveguide to an angle above the critical angle for total internal reflection within each waveguide. The distribution optical features serve to direct the light to the appropriate exit point, and the out-coupling features serve to deflect the image-like modulated light out of the plane of each light guide toward the user's eye. The left and right eye projectors 936-a, 936-b are optically coupled to the respective transparent eyepieces 926-a, 926-b by being positioned across and directed into the in-coupling optical features. Each eyepiece 926 may include a stack of multiple waveguides by including optical features that handle different color channels and impart different field curvatures to the image-wise modulated light to simulate different virtual object distances to the user. An inertial measurement unit (IMU) 928 is attached to the eyewear frames 924-a, 924-b.

[0077] A left augmented reality earphone 920 and a right augmented reality earphone 922 are provided. As shown in Fig. 9, the left and right augmented reality earphones 920, 922 conform to the design shown in Fig. 1A, however, alternatively, other designs according to the teachings provided herein may be used in place of the design shown in Fig. 1A for the augmented reality device 900. For example, an audio input circuit 910, which may have an internal design conforming to the teachings herein, as described above with reference to Figs. 5A, 5B, 5C, 6A, 6B, 6C, is coupled to the left augmented reality earphone 920 via a left woofer audio signal conduit 912 and a left tweeter audio signal conduit 914, and to the right augmented reality earphone 922 via a right woofer audio signal conduit 916 and a right tweeter audio signal conduit 918. It should also be noted that these audio playback components may be expanded and configured within the context of the present augmented reality device 900, as described elsewhere in this disclosure.

[0078] The video and audio processing system 930 generates visual and audio content, drives the projectors 936-a, 936-b and the augmented reality earphones 920, 922, and outputs 3D virtual content that augments the real-world visual and audio content sensed by the user. The processing system 930 includes a head pose tracker 934 that receives sensor data from an inertial measurement unit 928. The inertial measurement unit 928 can include, for example, three gyroscopes that measure rotation rates about three orthogonal axes, and three accelerometers that measure gravity and acceleration along three orthogonal axes. The inertial measurement unit can be supplemented with one or more cameras and an image processing system that contributes to head pose estimation by performing visual odometry. The head pose tracker 934 filters (e.g., Kalman filter) and integrates the sensor data to determine at least the orientation, and optionally the position coordinates, of the eyewear frames 924-a, 924-b. The head pose tracker 934 is coupled to the graphics processor 932 and provides head coordinate information thereto. The graphics processor 932 is coupled to the left-eye projector 936-a and the right-eye projector 936-b through left and right visual signal conduits 932-a and 932-b, respectively. The graphics processor generates left-eye and right-eye image information for rendering 3D virtual content and driving the projectors 936-a, 936-b. The coordinates generated by the head pose tracker 934 are used by the graphics processor 932 to maintain the position of the virtual content relative to the real world despite movement of the eyewear frames 924-a, 924-b (along with the user's head). Thus, if a virtual character is positioned standing in the doorway of a user's room, the virtual character will remain standing in the doorway if the user rotates its head 30 degrees to the left.

[0079] The processing system 900 further includes virtual sound sources 940, 940-1, 940-2, including a first virtual sound source 940, a second virtual sound source 940-1, and a third virtual sound source 940-2 as a non-limiting example in the embodiment illustrated in FIG. 9A, and it should be understood that the number of virtual sound sources can be set arbitrarily. In a typical case, there is more than one of the virtual sound sources 940, 940-1, 940-2, which are all coupled to an audio mixer 902. The audio mixer 902 includes a left mixer output 904 and a right mixer output 906, which are coupled to an input circuit 910. The internal details of the first virtual sound source 940 are highlighted in FIG. 9, and the remaining virtual sound sources 940-1, 940-2 can have corresponding designs or can be different if the need arises for a special application. As shown, the first virtual sound source 940 includes a mono sound source 942 that couples a mono audio stream via audio signal conduit 944-a and an associated 3D virtual sound source position via 3D position information signal conduit 944-b to the 3D audio spatializer 946. The third input used by the 3D audio spatializer 946 is the user's current head pose (position and orientation), received via head pose signal conduit 934-2 from the head pose tracker 934. The 3D audio spatializer 946 combines the 3D virtual sound source position and the user's head pose to determine the coordinates of the virtual sound source in a coordinate system fixed to the user's head. This is accomplished by a coordinate transformation. Note that in an augmented reality system, the coordinates of the virtual sound source are defined in a coordinate system that is fixed to the physical environment in which the device 900 is being used. For example, a virtual cartoon character may be placed on an actual chair in the user's physical room. The purpose of transforming the coordinates of the virtual sound source into a coordinate system fixed to the user's head is so that an appropriate "head-related transfer function" (HRTF) can be selected based on the coordinates of the virtual sound source relative to the user's head. HRTFs model the effect of the human head and upper torso on sound and are elevation, azimuth, and distance dependent. HRTFs include a pair of transfer functions, one for each ear.The presence and specific geometry of the head and torso cause time delays, phases, and amplitude differences in the sounds arriving at the two ears of a person when the sound source is not located on the sagittal plane of the person's head. The time delays, phases, and amplitude differences provide the person's auditory system with cues that are used by the brain to sense the direction to the sound source. The time delays, phases, and amplitude differences are contained in the HRTFs for each ear. Thus, by applying a selected HRTF to the sound, the sound can be perceived as originating from a specific position relative to the person's head that is associated with the selected HRTF. The stereo audio stream generated by the spatializer 946 is coupled via a pair of stereo audio signal conduits 948a, 948b to an audio mixer 902, which mixes as many sound sources as are present in a composite stereo output that is coupled to the input circuitry 910 via a left mixer output 904 and a right mixer output 906.

[0080] Device 900, being an augmented reality device, includes components 926-a, 926-b, 936-a, 936-b mounted in eyewear frames 924a, 924b that present digital content to the user while still allowing the user to see the real world through the display. Similarly, in the audio system, device 900 allows the user to hear the generated content in high fidelity while also hearing real world sounds in high fidelity that are not impeded by the audio system of device 900. Thus, the non-occluded high fidelity audio playback capabilities detailed in the previous figures are an excellent match for devices such as 900 that need to display both audio and video without affecting real world views or sounds. (In contrast, "virtual reality" devices are similar in design, but non-occluded audio is not required because they block real world light).

[0081] The video and audio processing system 930 of the device 900 may include hardwired electronics (an application specific integrated circuit (ASIC), e.g., an audio coder / decoder integrated circuit (codec IC), a video codec, a display driver IC, etc.), a field programmable gate array (FPGA), a processor coupled to a memory that stores program code executed by the processor, or a combination of two or more of the foregoing.

[0082] In device 900, video and audio processing system 930 generates virtual visual content that is output via left eye visual signal conduit 932a and right eye visual signal conduit 932b. The difference between the left eye visual output and the right eye visual output of device 900 is similar to the corresponding difference in the real world as seen from a person's left and right eyes. Both contain the same visual content viewed from a 3D perspective, but the viewing position is slightly different for each eye. A visual projector for left eye 936-a and a visual projector for right eye 936-b receive slightly offset graphic images from processing system 930 and output them via left and right displays 926a, 926b.

[0083] FIG. 9B shows a head-mounted augmented reality device 950 according to another embodiment. Many aspects of the device 950 are common to the device 900 shown in FIG. 9A, and reference is made to the above description for the description of these aspects. The head-mounted augmented reality device 950 includes an eyewear frame 974-a, 974-b including a left portion 974-a and a right portion 974-b. The device 950 also includes a left augmented reality earphone 970 and a right augmented reality earphone 972. However, unlike the more tightly integrated earphones 920, 922 of FIG. 9A, for the earphones 970, 972, the mounting of the woofer component is treated separately from that of the tweeter component. The left ear clip-mounted attachment 970c supports the left woofer component 970a such that when the eyewear frames 974-a, 974-b are positioned on a typical user wearing an appropriately sized device 950 (the device 950 can be provided in different sizes to fit different users), the sound outlet 976 of the left woofer component 970a is located within 1.5 centimeters, and preferably within 1.2 centimeters, of the center of the opening of the left ear canal. An equivalent right side component is provided, including a right ear clip-mounted attachment 972-c, a right woofer component 972a, and a right woofer audio outlet 978, which is positioned within 1.5 centimeters, preferably within 1.2 centimeters, of the center of the right ear canal opening when the eyewear frames 974-a, 974-b are positioned on a typical user's head (represented by an IEC 60318-7 audio test dummy head) for which the head-wearable device 950 is appropriately sized.

[0084] A separate left tweeter support structure 970-d attached to the left portion 974-a of the eyewear frame 974-a, 974-b supports the left tweeter component 970-b in a position spaced apart from the opening of the user's ear canal. The left tweeter component 970-b includes a left tweeter sound outlet 980. A larger sound stage effect can be obtained when the tweeter component sound outlet 980 is spaced apart from the opening of the user's ear canal. The left tweeter sound outlet 980 is preferably spaced apart from the centre of the opening of the left ear canal by a distance of ½ to 6 centimetres, more preferably 2 to 6 centimetres, when the eyewear frame 974-a, 974-b is positioned on a typical user's head wearing an appropriately sized device. A comparable right component is also provided, including a right tweeter support structure 972-d, a right tweeter component 972b and a right tweeter sound outlet 982.

[0085] Looking at the left earphone 970 of FIG. 9B, in function it is substantially similar to the earphone 170 of FIG. 1B. Indeed, one can easily imagine a device quite similar to device 950, but in which an earphone substantially similar to earphone 170 of FIG. 1B is used. Indeed, such a configuration is considered an effective form of the invention. However, in the case of device 950, tweeter component 970b is not mounted on mounting attachment 970c (or an extension therefrom) as seen in the previous configuration. Instead, tweeter 970b is mounted on mounting attachment extension 970d, which itself is attached to a head-straddling mounting attachment 974, which forms a frame for the overall augmented reality device.

[0086] FIG. 10 shows a cross-sectional view of an audio test dummy head 1000 with artificial ears and ear canals, and speaker components of a head-mounted sound reproduction device according to the present teachings located next to each ear of the audio test dummy head 1000. This figure shows different perspective views of some of the components seen in FIG. 1A (and other figures), specifically, the woofer components 122 and 132. A cross-section corresponding to FIG. 10 is shown in FIG. 1A. In addition, the speaker component 360 in FIG. 3D shows a detailed view of the speaker component shown in FIG. 10. FIG. 10 depicts an audio test dummy head 1000 including a left artificial pinna 1002 and a right artificial pinna 1004, a left artificial tragus 1006 and a right artificial tragus 1008, and a left artificial ear canal 1010 and a right artificial ear canal 1012. A pair of left and right speaker components 360 are shown in cross section with their sound exits 370 of their sound tunnels 368 extending only partially across the opening of each ear canal 1010, 1012. As viewed from the center of the opening of the ear canals 1014, 1016, the ear canals still have significant "openness" to the outside world as indicated by the two highlighted solid angles 1018, 1020. According to an embodiment, when the head-mounted sound reproduction device is properly mounted on the user's head or an audio dummy test head IEC 60318-7 (where the device is appropriately sized, as the device may be sold in multiple sizes to fit different sized heads) relative to the center point of the opening of the ear canal, the air impermeable portion of the device will cover 20% to 80% of the portion of the 4π solid angle centered on the center point that is not covered by the audio test dummy head. Thus, assuming the user's hair is pulled back and there is no over-ear head covering, e.g., a hat, or other structure that may obstruct hearing, there will be a clear line of sight to the surrounding environment for at least 20% of the solid angle centered on the center of the ear canal opening that is not covered by the audio test dummy head (user representative) itself.Sounds originating in the real-world environment of a user of a mixed reality device, including a head-mounted sound reproduction device as taught herein, will therefore have a sufficiently low impedance path into the user's ear so that hearing such real-world sounds is not impeded and the real-world audio components of the mixed or augmented reality experience will not be degraded. As a result, the close proximity of the sound outlet 370 to the user's ear canal allows for a strong low-frequency portion of the virtual audio component of the mixed or augmented reality experience. The inventors have determined that effective coupling of the higher frequency portions of the virtual audio components can be obtained without close proximity of the sound outlet of the associated tweeter component (not shown in FIG. 10) to the opening of the ear canal, and it has also been shown that audio spatialization is more effective when the tweeter component sound outlet is spaced away from the opening of the ear canal.

[0087] While the illustration of Figure 10 shows only a single 2D cross-section, an understanding of the 3D placement of the speaker components 360 relative to the dummy head 1000 can be easily gleaned by correlating the illustration of Figure 10 with that of Figure 1A. It should also be noted that the speaker component placement shown in Figure 10 and the type of speaker components used represent only one of many possible configurations that may provide a similar or better level of openness to the outside world such that sounds from the outside world may be heard with little or no perceptual coloration.

[0088] Fig. 11A is a cross-sectional view of a first integrated woofer and tweeter component 1100 (hereinafter referred to as the first integrated component) that can be used as a replacement for the woofer and tweeter components used in the sound reproduction devices shown in Figs. 1A, 2A, and 9A. The first integrated component 1100 includes a woofer driver 1102 having a back side 1103 that faces into a woofer rear volume 1114 defined by a woofer rear enclosure 1111 and a front side 1105 that faces into a woofer front volume 1106 defined by a woofer front enclosure 1113. The rear enclosure 1111 includes a port 1118 to the surrounding environment. The tweeter component 1104 includes a back side 1107 that faces into a tweeter rear volume 1116 defined by a tweeter rear enclosure 1115, and a front side 1109 that faces into a tweeter front volume 1108 defined by a tweeter front enclosure 1117. The woofer front volume 1106 and the tweeter front volume 1108 are adjacent and contiguous with a common front volume 1110 defined by a common enclosure 1119. A woofer front port 1121 is formed between the woofer front enclosure 1113 and the common enclosure 1119. A tweeter front port 1123 is formed between the tweeter front enclosure 1117 and the common enclosure 1119. The common enclosure 1119 includes an audio outlet 1112 that opens to the surrounding environment for sound to be emitted to the user's ear.

[0089] 11B is a cross-sectional view of a second integrated woofer and tweeter component (hereinafter referred to as the second integrated component) 1150 that can be used as a replacement for the woofer and tweeter components used in the sound reproduction devices shown in FIGS. 1A, 2A, and 9A. The second integrated component 1150 includes a woofer driver 1152 having a back side 1166 that faces into a woofer rear volume 1160 defined by a rear enclosure 1165. The rear enclosure 1165 includes a port 1162 to the surrounding environment. A front side 1167 of the woofer component 1152 faces into a front volume 1164 defined by a front enclosure 1168. The tweeter driver 1154 is supported in the front volume 1164 in front of the woofer driver 1152. The sound tunnel 1156 has a proximal end that is connected to the front enclosure 1168 and a distal open end that serves as the sound exit 1158 .

[0090] FIG. 12A is a cross-sectional view of an earphone 1200 that may be used as a replacement for the woofer and tweeter components used in the audio reproduction devices shown in FIGS. 1A, 1B, 2A, 2B, 9A, 9B. The earphone 1200 includes a speaker component 340 (FIG. 3C) implemented as a woofer and tweeter 1202. The tweeter 1202 of FIG. 12A is similar in many respects to the speaker component 340, but includes an extended length of an audio tunnel 1204 that is preferably at least 1.5 centimeters long, preferably at least 2 centimeters long, e.g., 3 centimeters long. The tweeter 1202 includes a speaker driver 1206 positioned proximate a first end of the audio tunnel 1204. A second open end of the audio tunnel 1204 serves as an audio outlet 1208 for the tweeter 1202. As a result, the tweeter sound outlet 1208 is spaced farther away from the tweeter speaker driver 1206 found in the previous embodiment. The advantage of having a longer sound tunnel 1204 is that you get some of the "extended sound stage" benefits of spacing the tweeter driver 1206 away from the ear canal, while also getting some of the privacy benefits of locating the sound outlet 1208 closer to the ear canal.

[0091] FIG. 12B is a cross-sectional view of an earphone 1210 that may be used as a replacement for the woofer and tweeter components used in the sound reproduction devices shown in FIGS. 1A, 1B, 2A, 2B, 9A, 9B. The earphone 1210 includes a speaker component 340 (FIG. 3C) implemented as a woofer and a separate tweeter 1212. The tweeter 1212 of FIG. 12B is similar in many respects to the speaker component 340, but includes a sound reflecting surface 1214 with an optional sound attenuating diffuser 1216 attached at the end of the sound tunnel 354. The sound reflecting surface 1214 and sound attenuating diffuser 1216 are similar to those shown in FIG. 4C, however, the sound reflecting surface 1214 of the earphone 1210 is longer than that shown in FIG. 4C, preferably 2-3 centimeters in length. Although not clearly visible in the cross-sectional view of FIG. 12B, the sound reflecting surface 1214 can have a compound concave curvature. The shape can be a curved half-pipe, a partial toroid, or a portion of a surface of revolution with a conical section generatrice. An example of the latter would be a half-ellipsoid with one focus at the sound outlet and one focus at the user ear canal opening. In addition, a portion of the sound reflecting surface 1214 is used to mount an optional sound attenuating diffuser 1216 that slightly randomizes the directionality of the output sound waves (to make the sound less "fragile" and more "diffuse"). The advantage of having an extended sound reflecting surface is that you get some of the "extended sound stage" benefits of spacing the tweeter away from the ear canal, while also getting some of the privacy benefits of locating the sound outlet close to the ear canal. The sound reflective surface can be attached in a variety of ways, such as to the sound tunnel as shown in FIG. 12B, the speaker driver as shown in FIGS. 4C-4D, and / or other portions of the speaker components, such as the front volume, and other types of mounting attachments.

[0092] 13A-13B show a head-mounted sound reproduction device 1300 including an input circuit block 1310, a left earphone 1320, a right earphone 1330, and audio signal conduits 1312, 1314-a, 1314-b, 1316, 1318-a, 1318-b. In addition, an external audio source 1302, which may not be part of the device 1300, provides stereo audio signals (1304, 1306) as an input. The external audio source 1302 is coupled to the input circuit 1310 via a left audio signal conduit 1304 and a right audio signal conduit 1306. For simplicity, the description will be given primarily with reference to the left earphone 1320, it being understood that the right earphone 1330 has a substantially similar structure and function as the left earphone 1320. Unless otherwise indicated, the reference numbers of the elements of the right earphone 1330 differ from the reference numbers of the elements of the left earphone 1320 by substituting the number 3 for the number 2 in the third digit. The left woofer signal conduit 1312 couples the input circuit 1310 to the woofer component 1322. (There is a corresponding right woofer signal conduit 1316). Unlike the previous embodiment, the device 1300 includes two tweeters per ear. The first left tweeter signal conduit 1314-a couples the input circuit 1310 to the first left tweeter component 1324 located near the user's ear canal. (There is a corresponding first right tweeter signal conduit 1318-a). The second left tweeter signal conduit 1314-b couples the input circuit 1310 to the second left tweeter component 1325 that is spaced away from the user's ear canal. (There is a corresponding second right tweeter signal conduit 1318-b).

[0093] In FIG. 13A, the tweeter pair that is far away from the user's ear canals 1325, 1335 is currently active, as indicated by the dashed tweeter signal conduits 1314-b, 1318-b. For the tweeter pairs that are closer to the user's ear canals 1324, 1334, the solid lines for their respective tweeter signal conduits 1314-a, 1318-a indicate that these tweeters are currently active. This enabling of the near tweeter and disabling of the far tweeter can be further seen on the left side within the input circuit block 1310, where an audio switch 1319-a connects the near tweeter signal conduit 1314-a and leaves the far tweeter signal conduit 1314-b disconnected. The audio source for the audio switch 1319-a is the left channel input 1304 that originates from the external audio source 1302 (the internal routing of the input circuit block 1310 is not shown due to space constraints). Similarly, the right audio switch 1319-b performs a similar role, connecting the right channel input 1306 to the nearby tweeter signal conduit 1318-a. The settings of the two audio switches 1319-a, 1319-b are controlled by a control line 1329-b originating from the left earbud 1320, and more specifically, from a user-activated button 1329-a (many forms of user-activated switch control may be effective) mounted on the left ear clip 1326. In FIG. 13A, the user-activated button 1329-a is seen in the "up" position, which corresponds to a state of the device 1300 whose audio performance is substantially similar to that of the device shown in FIGS. 1A, 2A, and 9A.

[0094] In Figure 13B, user activation button 1329-a has been pressed by a user, as seen by its "down" position. Control line 1329-b communicates this new setting to audio switches 1319-a, 1319-b, which now connect to far tweeter signal conduits 1314-b and 1318-b (respectively), shown with solid lines indicating that far tweeters 1325, 1335 are now active. Correspondingly, audio switches 1319-a, 1319-b no longer connect to near tweeter signal conduits 1314-a and 1318-a (respectively), which are now shown with dashed lines indicating that near tweeters 1324, 1334 are now inactive. Thus, by pressing the user activation button 1329-a, the user has switched the device 1300 to a state in which its audio performance is substantially similar to that of the device shown in Figures 1B, 2B, and 9B. By pressing the button 1329-a again and returning it to the "up" position, the user can return the device 1300 to the state shown in Figure 13A, allowing the user to switch between the two states at will. This ability allows the user to quickly and easily choose between the competing goals of privacy versus an extended "sound stage." A closer distance (Figure 13A) provides more privacy with less leakage or "sound leakage," but with a less than maximum "sound stage" due to the proximity of the tweeter component to the ear. A farther distance (Figure 13B) provides less privacy with more leakage or "sound leakage," but at the same time the "sound stage" is extended due to the greater distance of the tweeter component.

[0095] The left woofer component 1322 includes an audio outlet 1322a that is positioned within 1.5 centimeters, preferably within 1.2 centimeters, of the center of the opening of the ear canal when the head-mounted playback device 1300 is properly mounted on the user's head, taken as represented by an appropriately sized IEC 60318-7 audio test dummy head (it should be understood that the device may be provided in multiple sizes). The close proximity of the audio outlet 1322a of the woofer component, combined with the low frequency excess boost, represented for example by the portion 756-758 of the low pass filter frequency response shown in FIG. 7B, produces a powerful and effective bass sound, despite the fact that the audio outlet 1322a is not sealingly engaged in the ear canal (as is the case with some earphones). Thus, the user can enjoy a powerful and effective bass sound without infringing on the user's ability to hear the environmental sounds. The ability to hear both the environmental sounds and the sounds output through the head-mounted sound reproduction device 1300 is highly beneficial for a mixed or augmented reality device.

[0096] In an optional (although useful) extension within the input circuit block 1310, the control line 1329-b is received by the left processing blocks 1311 and 1313, and also by the right processing blocks 1315 and 1317. Considering only the left side (the right side is substantially similar), the processing block 1311 is an audio delay similar in role and function to the audio delay 580a of FIG. 5C. Recall that the audio delay 580a can then be optionally introduced into the woofer signal chain to compensate for the sound wave arrival time difference that would otherwise occur when the tweeter is farther from the ear canal than the woofer. In the device 1300, the "delay time" parameter of the audio delay 1311 is varied based on the setting of the user-activated button 1329-a, which is conveyed via the control line 1329-b. This mapping is programmed so that the time amount compensation is always correct regardless of whether the near or far tweeter is active. Presently preferred "delay times" range from 0 microseconds when the near tweeters 1324, 1334 are active (as seen in FIG. 13A), to a maximum of approximately 100 microseconds when the far tweeters 1325, 1335 are active (as seen in FIG. 13B).

[0097] In addition to the real-time delay control, the input circuit 1310 includes a processing block 1313 that is a volume (gain) control. This processing block 1313 provides an automatic volume (gain) adjustment based on the setting of the user-activated button 1329-a to compensate for currently active tweeters that are closer to or farther from the ear canal. This ensures that the perceived volume of the tweeter output will remain constant as one switches between near and far tweeters. Distance versus loudness calculations can be used to determine the mapping between volume and speaker location. The currently preferred "volume adjustment" ranges from 0 dB when the near tweeters 1324, 1334 are active (as seen in FIG. 13A) to a maximum of about 15 dB boost when the far tweeters 1325, 1335 are active (as seen in FIG. 13B).

[0098] More generally, the head-mounted device detailed within this disclosure offers a unique combination of benefits: head-mounted audio reproduction that is substantially unobstructed, clear to the ear, and maintains high fidelity even at low frequencies that are heard together with real-world sounds. The audio industry has been working to resolve the gap between these two goals for some time, but solutions have proven elusive. The device presented in this disclosure is the first to fully bridge this gap, an achievement that is both novel and useful, particularly for applications in augmented reality and for unobstructed listening, and generally, simply put, the gold standard for audio is that both the reproduced audio and the real-world sounds should sound "right".

[0099] In the foregoing specification, the invention has been described with reference to specific embodiments thereof. It will be apparent, however, that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. For example, the process flows described above are described with reference to a particular ordering of process actions. However, the ordering of many of the described process actions may be altered without affecting the scope or operation of the invention. The specification and drawings are therefore to be regarded in an illustrative rather than restrictive sense.

Claims

1. A head-wearable device, comprising: a woofer component including a woofer sound outlet; a tweeter component including a tweeter audio outlet; a support structure configured to provide mechanical support for the woofer and tweeter components, the woofer sound outlet being spaced from the tweeter sound outlet by at least ½ centimeter; an input configured to receive an audio signal; a woofer output coupled to the woofer component; a tweeter output coupled to the tweeter component; an audio signal filter coupled to the input and drivingly coupled to the woofer component through the woofer output, the audio signal filter configured to apply a first gain to at least a first frequency band within a first frequency range extending from 20 Hz to 100 Hz, the audio signal filter further configured to apply a second gain to at least a second frequency band within a second frequency range extending from 100 Hz, the first gain substantially exceeding the second gain; a see-through display coupled to the support structure, the see-through display configured to rest proximate to an eye of a user of the head-wearable device; and one or more sensors configured to determine a posture of the head wearable device, the audio signal being determined based on the posture; Equipped with the distance between the tweeter component and the woofer component is adjustable; A head-wearable device, wherein the distance between the tweeter component and a user's ear canal is adjustable.

2. The head-wearable device further comprises one or more air-impermeable portions comprising one or more air-impermeable materials; The head-wearable device of claim 1 , wherein the one or more air impermeable portions comprise one or more of the woofer component, the tweeter component, and the support structure.

3. The head-wearable device of claim 1, further comprising a channel delay between the input and the woofer output.

4. A head-wearable device as described in claim 1, wherein the first gain exceeds the second gain by at least 10 dB.

5. A head-wearable device as described in claim 1, wherein the support structure includes an ear clip mounting structure.

6. A head-wearable device as described in claim 1, wherein the support structure includes a head-straddling mounting structure.

7. The audio signal filter comprising a crossover filter comprising a low pass filter, the crossover filter having a crossover frequency, The head wearable device of claim 1 , wherein the second frequency range extends from 100 Hz to a maximum of the crossover frequency.

Citation Information

Patent Citations

  • A built-in amplifier card - - speaker system

    JP1985101896U

  • Headphone system,

    JP1995203575A

  • Reproducing device for audio acompanied with video

    JP1996009490A

  • Ear speaker apparatus

    JP2008141691A

  • Head-mounted display device and head-mounted display device control method

    JP2014078868A