Earbud assembly for a hear-through audio system

Abstract

An earbud assembly presents audio content to an ear canal of a user. The audio content may be based in part on sounds in a local area surrounding the user. The earbud assembly detects sounds in the area surrounding the user through one or more acoustic sensors. Sound waves pass through holes in a body of the earbud assembly and propagate to a waveguide leading to the one or more acoustic sensors. The earbud assembly processes the detected sound data in a controller, which instructs a speaker assembly to present the audio content based in part on the detected sound data. When presented by the speaker assembly, the detected sound may be amplified, attenuated, filtered, and / or enhanced.

Description

Technical Field

[0001] The present disclosure relates generally to audio systems in headsets, and in particular to earbud assemblies in hear-through audio systems.

[0002] background

[0003] Head-mounted devices often include features such as an audio system to provide audio content to a user of the head-mounted device. Traditionally, a user of a head-mounted device wears headphones to receive or otherwise experience computer-generated sounds. However, wearing headphones suppresses sounds from the real-world environment, which may expose the user to unexpected dangers and may also inadvertently isolate the user from the environment.

[0004] Overview

[0005] The earplug assembly is an in-ear device configured to present improved audio content to a user. The earplug assembly is configured to be at least partially assembled in the ear canal of the user. The earplug assembly includes a body, one or more holes, one or more acoustic sensors and a speaker. When the user wears the earplug assembly, at least one of the one or more holes is located at or substantially close to the entrance of the ear canal. The positioning of the hole at the entrance of the ear canal or substantially close to the entrance of the ear canal helps to retain spatial cues. The one or more holes are the entrances of one or more acoustic waveguides, which guide the sound from the local area around the user to one or more acoustic sensors located in the body. The one or more acoustic sensors detect the sound. One or more speakers are coupled to a portion of the body and present the audio content in the ear canal of the user based on the detected sound.

[0006] According to a first aspect of the present invention, an earplug assembly is provided, which includes: a main body, which is configured to be at least partially mounted in an ear canal of a user, the main body being configured to have a hole located near the entrance of the ear canal, the hole being the entrance of an acoustic waveguide, which guides sound from a local area around the user to an area within the main body; an acoustic sensor located within the area within the main body, the acoustic sensor being configured to detect sound from the local area; and a speaker coupled to a portion of the main body, the speaker being configured to present audio content in the ear canal based in part on the sound detected from the local area.

[0007] In some embodiments, the body is partially enclosed within a flexible covering that conforms to the shape of the ear canal and seals against the ear canal.

[0008] In some embodiments, the aperture is located between the microphone and the speaker, and the body portion coupled to the speaker is configured within the ear canal.

[0009] In some embodiments, the aperture includes a first side and a second side, and an angle between the first side and the second side measured relative to a central axis of the body is at least 280 degrees.

[0010] In some embodiments, the body further comprises an additional hole which is an additional inlet for the acoustic waveguide.

[0011] In some embodiments, the assembly further comprises an additional acoustic sensor for receiving sound from a local area, the acoustic sensor being located on a surface of the body.

[0012] In some embodiments, the assembly further includes an additional acoustic sensor located in a region of the body configured to fit within the ear canal.

[0013] In some embodiments, the additional acoustic sensor is located proximate an aperture along a surface of the body, the aperture being located in an area of ​​the body configured to fit within the ear canal.

[0014] In some embodiments, sound is transmitted to the acoustic waveguide through an aperture located in a region of the body configured to fit in the ear canal and the sound is presented to the inner ear of the user.

[0015] In some embodiments, the main body includes a first part and a second part, and the first part is configured to be at least partially assembled in the ear canal of the user, and the second part is configured to be located outside the ear canal. The earplug assembly also includes: an additional acoustic sensor located in the second part of the main body; and an additional acoustic waveguide located in the first part and the second part of the main body, wherein the sound in the ear canal is transmitted to the additional acoustic sensor through the additional acoustic waveguide.

[0016] In some embodiments, the speaker is located on a surface of the body.

[0017] In some embodiments, the assembly further comprises a waveguide coupling the speaker to the hole along the surface of the body, wherein sound from the speaker propagates through the waveguide and exits the hole into the ear canal.

[0018] In some embodiments, the aperture is located in a portion of the body configured to fit within an ear canal.

[0019] In some embodiments, the assembly further includes a controller configured to control what audio content is presented by the speaker.

[0020] In some embodiments, a method for presenting adjusted audio content through an earbud assembly is disclosed. The method includes detecting sound from an area surrounding a user via the earbud assembly, generating a sound filter using the sound detected from the local area, and presenting the adjusted audio content based in part on the sound filter to an ear canal of the user via the earbud assembly.

[0021] According to a second aspect of the present invention, a method is provided, the method comprising: detecting sound from a local area around a user through an earplug assembly; generating a sound filter using the sound detected from the local area; presenting adjusted audio content based in part on the sound filter to the ear canal of the user via the earplug assembly, wherein the earplug assembly comprises: a main body configured to be at least partially mounted in the ear canal of the user, the main body configured to have a hole located near the entrance of the ear canal, the hole being the entrance of an acoustic waveguide that guides the sound from the local area to the area within the main body; an acoustic sensor located in the area within the main body, the acoustic sensor being configured to detect sound from the local area; and a speaker coupled to a portion of the main body, the speaker being configured to present the adjusted audio content in the ear canal based in part on the sound detected from the local area.

[0022] In some embodiments, the body is partially enclosed within a flexible covering that conforms to the shape of the ear canal and seals against the ear canal.

[0023] In some embodiments, the hole is located between the microphone and the entrance to the ear canal.

[0024] In some embodiments, the aperture includes a first side and a second side, and an angle between the first side and the second side measured relative to a central axis of the body is at least 280 degrees.

[0025] In some embodiments, the body further comprises an additional hole which is an additional inlet for the acoustic waveguide.

[0026] In some embodiments, sound is transmitted to the acoustic waveguide through an aperture located in a region of the body configured to fit within the ear canal and the sound is presented to the inner ear of the user.

[0027] It will be appreciated that any feature described herein as suitable for incorporation into one or more aspects or embodiments of the present invention is intended to be generalizable to any and all aspects and embodiments of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 is a cross-sectional view of an earbud assembly within an ear canal of a user according to one or more embodiments.

[0030] Figure 2A is a perspective view of an earbud assembly according to one or more embodiments.

[0031] Figure 2B According to one or more embodiments Figure 2A A cross-sectional side view of an earbud assembly.

[0032] Figure 2C According to one or more embodiments Figure 2A A top cross-sectional view of an earplug assembly.

[0033] Figure 2D is a cross-sectional side view of another embodiment of an earbud assembly having an internal acoustic sensor positioned adjacent an external acoustic sensor in accordance with one or more embodiments.

[0034] Figure 2E is a cross-sectional side view of another embodiment of an earbud assembly having a speaker bezel and a nozzle according to one or more embodiments.

[0035] Figure 3 is a block diagram of an earbud assembly according to one or more embodiments.

[0036] Figure 4A is a perspective view of a head mounted device implemented as an eyewear device according to one or more embodiments.

[0037] Figure 4B is a perspective view of a head mounted device implemented as a head mounted display according to one or more embodiments.

[0038] Figure 5 is a block diagram of an exemplary artificial reality system environment including an earbud assembly according to one or more embodiments.

[0039] The accompanying drawings depict various embodiments for purposes of illustration only. One skilled in the art will readily recognize from the following discussion that alternative embodiments of the structures and methods shown herein may be employed without departing from the principles described herein.

[0040] Detailed Description

[0041] An earbud assembly presents audio content to a user by operating as a hear-through audio system. The earbud assembly detects sounds from a local area around the user and relays them to the user.

[0042] The earplug assembly includes many components that can be coupled to the main body. In addition to the main body, the earplug assembly also includes components such as one or more acoustic sensors, speakers and waveguides. The earplug assembly also includes a controller and a power supply assembly. The earplug assembly is configured to be at least partially assembled in the user's ear canal. The main body is configured to have a hole that is adjacent to or close to the user's ear canal and is not blocked, so that the sound from the local area enters the sound waveguide through the hole. The sound waveguide guides the sound to the acoustic sensor in the main body, which detects the sound from the local area. The sound is processed by the controller, and the controller instructs the speaker to broadcast audio content to the user's ear canal. The audio content can be based in part on the sound detected from the local area. In some embodiments, the controller can instruct the speaker to present filtered and / or enhanced audio content to the ear canal.

[0043] The earbud assembly functions as an audio system that preserves monaural and binaural spatial cues. The earbud assembly preserves spatial cues through a port acoustic sensor located near the user's ear canal. Note that the noise is inversely proportional to the size of the microphone. The earbud assembly also includes sufficient space for larger acoustic sensors than those in traditional hear-through systems, so that less noise is generated and perceived by the user. In contrast to traditional hear-through systems, in some embodiments, the earbud assembly also includes one or more internal acoustic sensors that are located within a portion of the body near the user's ear canal. The small form factor of the earbud assembly increases the bandwidth of monaural and binaural spatial cues preserved for the user. Sound from a localized area can be amplified, attenuated, enhanced, and / or filtered when relayed to the user.

[0044] Embodiments of the present invention may include an artificial reality system or be implemented in conjunction with an artificial reality system. Artificial reality is a form of reality that has been adjusted in some way before being presented to a user, and may include, for example, virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and / or derivative thereof. Artificial reality content may include fully generated content or content generated in combination with captured (e.g., real-world) content. Artificial reality content may include video, audio, tactile feedback, or some combination thereof, and any of which may be presented in a single channel or in multiple channels (e.g., stereoscopic video that produces a three-dimensional effect to the viewer). In addition, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, which are used, for example, to create content in artificial reality and / or to be used in other ways in artificial reality (e.g., to perform activities in artificial reality). Artificial reality systems that provide artificial reality content can be implemented on a variety of platforms, including head-mounted devices (e.g., head-mounted displays (HMDs) and / or near-eye displays (NEDs)) connected to a host computer system, stand-alone head-mounted devices, mobile devices or computing systems, or any other hardware platform capable of providing artificial reality content to one or more viewers.

[0045] System Overview

[0046] Figure 11 is a cross-sectional view 100 of an earbud assembly 105 within an ear canal 110 of a user according to one or more embodiments. The earbud assembly 105 detects sounds from a local area around the user and presents audio content to the user based in part on the sounds from the local area. The cross-sectional view 100 includes components of a user's ear, including an ear canal 110, an eardrum 115, and a pinna 120. The earbud assembly 105 includes a body 125, a flexible cover 130, an aperture 135, an external acoustic sensor 140, a speaker 150, a controller 155, and a power supply assembly 160. In some embodiments, the earbud assembly 105 includes an internal acoustic sensor 145. A portion of the earbud assembly 105 fits within the ear canal 110 of the user's ear so that the speaker 150 can present audio content to the eardrum 115 within the ear canal 110.

[0047] The body 125 is coupled to many other components of the earbud assembly. The body 125 is configured to fit at least partially within the ear canal 110 and is coupled to an external acoustic sensor 140, a speaker 150, and in some embodiments, an internal acoustic sensor 145. At least a portion of the body 125 fits within the ear canal 110 of the user's ear, while the remainder of the body 125 is unobstructed. In some embodiments, the portion of the body 125 that fits within the ear canal 110 of the user's ear can be shaped like a nozzle. The nozzle improves the quality of sound presented to the user, especially for high-frequency sounds. The nozzle can also be coupled to the flexible cover 130 and allow the flexible cover 130 to be customized to better fit the user's ear. The body 125 can be formed of one or more materials that attenuate sound, ensuring that the user is better able to hear the audio content produced by the speaker. For example, the body 125 can be composed of foam, silicone, plastic, rubber, or some combination thereof. The body 125 can be rotationally symmetrical about a central axis. In Figure 1 In the embodiment shown, the body 125 is substantially cylindrical with rounded ends, but in other embodiments, the body can have other geometric shapes.

[0048] The body 125 may be partially enclosed by a flexible cover 130. The flexible cover 130 prevents leakage of audio content presented by the speaker 150 in the ear canal 110. The flexible cover 130 seals the portion of the body 125 that is mounted in the ear canal 110, and is adapted to the shape of the ear canal. The flexible cover 130 may be composed of some sound-isolating materials, such as foam, silicone, or some combination thereof. The flexible cover 130 may have a form similar to that of an ordinary earplug. In some embodiments, the flexible cover 130 may be customized according to the shape of the user's ear canal, thereby enhancing the attenuation of unwanted sounds such as external loud noises. The customized flexible cover 130 may improve the fit and stability of the earplug assembly in the user's ear. In some embodiments, a portion of the flexible cover 130 may be composed of metal, such as aluminum, steel, or some combination thereof. The heavier flexible cover 130 improves the attenuation of unwanted sounds by reducing background noise and increasing the signal-to-noise ratio transmitted to the eardrum 115 of the user's ear. Thus, the heavier flexible cover 130 improves the quality of sound presented to the user, providing a more convincing hear-through experience.

[0049] Hole 135 is the entrance of the acoustic waveguide in the body. Figure 1 The body 125 may include a first portion of the body 125 (not shown) that directs sound from the local area to the external acoustic sensor 140. The hole 135 is located near the entrance of the ear canal, wherein at least a portion of the hole 135 is unobstructed. For example, the hole 135 can be located in an unobstructed portion of the body 125 so that it is located between the external acoustic sensor 140 and the entrance of the ear canal, as shown by the hole 135. The hole 135 is located on the surface of the body 125. The hole 135 has a first side and a second side on the surface of the body 125, such that the first side is separated from the second side by at least 280 degrees relative to the central axis of the body 125. In some embodiments, the body 125 may include a plurality of holes similar to the hole 135, each hole serving as an additional entrance to at least one acoustic waveguide.

[0050] The external acoustic sensor 140 monitors and detects sounds from a local area. The external acoustic sensor 140 is located in an unobstructed portion of the body 125 of the earplug assembly, near the hole 135. Therefore, the sound from the local area passes through the hole 135 and propagates to the external acoustic sensor 140 through the acoustic waveguide. The external acoustic sensor 140 may include, for example, a microphone, an accelerometer, other acoustic sensors, or some combination thereof. In some embodiments, the body 125 includes a plurality of acoustic sensors, at least one of which may be placed on the surface of the body 125. The external acoustic sensor 140 may be a microphone, an accelerometer, or another sensor that detects acoustic pressure waves. The external acoustic sensor 140 may transmit the acoustic data it detects to the controller 155 of the earplug assembly 105.

[0051] In some embodiments, the body 125 includes an internal acoustic sensor 145 that detects sounds from a local area and sounds transmitted via tissue conduction. For example, in addition to the earplug assembly 105, the user can wear a headset with an audio system that provides audio content through tissue conduction. Therefore, the internal acoustic sensor 145 can detect the acoustic content generated by vibrations to tissue near the user's skull. The internal acoustic sensor 145 can also detect the user's own voice. The user's own voice may be amplified due to the earplug assembly 105 blocking the ear canal 110. The internal acoustic sensor 145 can be a microphone, an accelerometer, or another sensor that detects sound pressure waves.

[0052] In addition to the external acoustic sensor 140 and the internal acoustic sensor 145, the earbud assembly 105 may include a plurality of sensors designated for purposes other than measuring audio data and / or a plurality of acoustic sensors substantially similar to the external acoustic sensor 140 and the internal acoustic sensor 145 described herein. For example, the other sensors within the earbud assembly 105 may include an initial measurement unit (IMU), a gyroscope, a position sensor, or a combination thereof.

[0053] According to the instructions received by the controller 155, the speaker 150 presents audio content in the ear canal 110 of the user. The speaker 150 may present audio content based in part on the sound from the local area around the user detected by the external acoustic sensor 140. In some embodiments, the speaker 150 may present audio content based in part on the sound detected by the internal acoustic sensor 145, that is, the sound transmitted via tissue conduction. In some embodiments, the controller 155 may instruct the speaker 150 to amplify, attenuate, enhance and / or filter the sound detected from the local area of ​​the user. For example, the speaker 150 can present enhanced audio content to the user for VR and AR head-mounted devices. The speaker 150 presents audio content in the ear canal 110 so that the sound vibrates the eardrum 115 and reaches the cochlea of ​​the inner ear of the user through the middle ear ossicular chain of the user's ear. The user's cochlea perceives the vibration as audio content. The speaker 150 can present audio content through air conduction. Through air conduction, the speaker 150 generates air-borne sound pressure waves and sends them to the user's eardrum, which vibrates and is detected by the user's cochlea. Tissue conduction involves vibrating tissue, such as bone or cartilage, in and / or near the user's ear, producing tissue-propagated sound pressure waves that are detected by the cochlea.

[0054] The speaker 150 is located within the body 125, near the eardrum 115 of the user's ear. The speaker 150 can be coupled to a portion of the body 125. The coupling can be such that there is indirect and / or direct contact between the speaker 150 and the body 125. In some embodiments, the speaker is located on a surface of the body 125 of the earbud assembly.

[0055] The controller 155 receives and processes sound data detected by the acoustic sensors within the earbud assembly 105, such as the external acoustic sensor 140 and the internal acoustic sensor 145. The controller 155 can be positioned within the body 125, such as within a portion of the body 125 configured to fit within the user's ear canal 110. For example, the power supply assembly 160 can power the sensors and speakers in the earbud assembly 105 via a battery. The earbud assembly can include other electronic components ( Figure 1 not shown).

[0056] The controller 155 may instruct the speaker 150 to present audio content based in part on the sound from the local area detected by the external acoustic sensor 140 and the sound transmitted via tissue conduction detected by the internal acoustic sensor 145. For example, the controller 155 may amplify the sound from the local area, causing the speaker 150 to present a larger sound from the local area in the user's ear canal. In another embodiment, the controller 155 may instruct the speaker 150 to present the sound from the local area from a large bandwidth, resulting in an increase in the frequency range that the user can hear. For use in artificial reality applications, the controller 155 may include a sound filter to enhance the sound detected from the local area. For example, the sound filter may be used to spatialize the sound so that the sound sounds from the virtual object being presented to the user, while also relaying the sound from the local area of ​​the user. The controller 155 may also attenuate the sound detected by the internal acoustic sensor 145. For example, when the sound pressure wave from the user's voice is transmitted through the user's tissue and / or bone, the internal acoustic sensor 145 may detect that the user's voice is amplified. Since the earplug assembly 105 blocks the user's ear canal 110, the user's voice may be amplified. The controller 155 may then instruct the speaker 150 to attenuate the user's own voice when presenting the audio content. Thus, the user may perceive their own voice more clearly and naturally while also perceiving the presented audio content. In another embodiment, the controller 155 may amplify and / or attenuate sounds detected from a local area that fall within a certain frequency range. For example, in a noisy environment near a train station, the speaker 150 may attenuate high-frequency train whistles when presenting audio content to the user's ear canal.

[0057] The power supply assembly 160 provides power to the earbud assembly 105. This power can be used to power the controller 155, the external acoustic sensor 140, the internal acoustic sensor 145, and the speaker 150 in the earbud assembly 105. For example, the power supply assembly 160 can be a battery. In some embodiments, there are one or more power supply assemblies 165 for some or all components of the earbud assembly 105. In some cases, the power supply assembly 160 is a rechargeable battery.

[0058] Figure 2Ais a perspective view 200 of an earplug assembly 105 according to one or more embodiments. The perspective view 200 shows Figure 1 The components of the earbud assembly 105 are shown such that the body 225 corresponds to the body 125, the aperture 235 corresponds to the aperture 135, the external acoustic sensor 240 corresponds to the external acoustic sensor 140, the speaker 250 corresponds to the speaker 150, the internal acoustic sensor 245 corresponds to the internal acoustic sensor 145, the controller 255 corresponds to the controller 155, and the power supply assembly 260 corresponds to the power supply assembly 160. FIG. 2 also shows a waveguide 275A, a waveguide 275B, and an aperture 265 coupled to the body 225. The body 225 is rotationally symmetric about the central axis 230. Note that the flexible cover 130 is omitted from the figure for simplicity.

[0059] The waveguides 275A, 275B guide sound waves to an area within the body 225 of the earbud assembly 200. The waveguide 275A may be positioned adjacent and / or near the aperture 235 so that sound pressure waves entering the aperture 235 are guided to the external acoustic sensor 240. The sound pressure waves entering the aperture 235 may come from a local area around the user.

[0060] The waveguide 275B can guide the sound waves generated by the speaker 220 to the hole 265 so that the sound generated by the speaker 220 is presented to the ear canal of the user (e.g., the ear canal 110). The waveguide 275B can also guide the sound waves transmitted by tissue conduction to the internal acoustic sensor 245. For example, an additional waveguide can be close to the hole 265 and propagate the sound to the internal acoustic sensor 245. Each of the waveguides 275A, 275B can be a tube, a channel, or some combination thereof.

[0061] The hole 265 allows sound waves that pass through the waveguide 275B to exit into the ear canal of the user. The hole 265 is located in a portion of the body 225 that fits in the ear canal of the user. The hole 265 can be substantially similar to the hole 235 in geometry.

[0062] Figure 2B is a cross-sectional side view 205 of the earplug assembly 105 according to one or more embodiments. Line B' represents the Figure 2C location.

[0063] Figure 2C 2 is a top cross-sectional view 210 of the earplug assembly 105 according to one or more embodiments. The top cross-sectional view 210 shows the earplug assembly 105 from the perspective of the earplug assembly 105. Figure 2B The earplug assembly 105 viewed from line B' in FIG. Figure 2C Aperture 235 and waveguide 275A are shown. Aperture 235 spans an angle θ between the first side and the second side relative to central axis 230. In some embodiments, angle θ may be at least 280 degrees.

[0064] Figure 2D is a cross-sectional side view 215 of another embodiment of an earbud assembly having an internal acoustic sensor positioned adjacent an external acoustic sensor in accordance with one or more embodiments. Figure 2D The earplug assembly in is basically similar to Figure 2B The earbud assembly shown in Figure 2D The earbud assembly in includes an internal acoustic sensor 245 coupled to an additional waveguide 275C. Figure 2C In the embodiment of the present invention, the internal acoustic sensor 245 is located in a portion of the body 225 that is located outside the user's ear canal. In some embodiments, the internal acoustic sensor 245 can be adjacent to the external acoustic sensor 240. The internal acoustic sensor 245 can be coupled to an additional waveguide 275C. The positioning of the internal acoustic sensor 245 enables a smaller size portion of the earplug assembly 105 to fit into the user's ear canal. Therefore, user comfort can be improved while retaining spatial cues from a local area around the user. The additional waveguide 275C can be substantially similar to waveguides 275A, 275B. The additional waveguide 275C guides the sound waves generated by the vibration to the tissue near the user's skull and / or the user's voice to the internal acoustic sensor 245. In some embodiments, the additional waveguide 275C can be separated from the waveguide 275B and / or not coupled to the waveguide 275B. Sound can enter through a hole of the body 225 that is separated from the hole 265, pass through the additional waveguide 275C and reach the internal acoustic sensor 245. In some embodiments, the additional waveguide 275C may reverberate, resulting in nulls in the sound waves detected by the internal acoustic sensor 245. The grid may be located in front of the internal acoustic sensor 245 to eliminate the nulls detected by the internal acoustic sensor 245. In some embodiments, the grid may be coupled to the internal acoustic sensor 245, while in other embodiments, the grid may be located at some distance away from the internal acoustic sensor 245.

[0065] Figure 2E is a cross-sectional side view 220 of another embodiment of an earbud assembly having a speaker bezel and a nozzle in accordance with one or more embodiments. Figure 2E The earplug assembly is basically similar to Figure 2B The earbud assembly shown in Figure 2D The earplug assembly in the embodiment includes a speaker front cover 280 and a nozzle 285. The speaker front cover 280 can be located at a certain distance from the speaker 250, for example, at least 0.6 mm. In some embodiments, the speaker front cover 280 can be located at a shorter distance from the speaker 250, for example, in the range of 0.1 mm to 0.2 mm. The shorter distance between the speaker front cover 280 and the speaker 250 can result in an improvement in the sound quality presented to the user. When the distance between the speaker front cover 280 and the speaker 250 is reduced, the user can also perceive a wider bandwidth of sound frequencies from a local area.

[0066] In some embodiments, Figure 2D The earbud assembly shown includes a nozzle 285. The nozzle 285 can be coupled to the waveguide 275B. The nozzle 285 can be a cylinder with a diameter of 1.5 mm, which can end in the hole 265. The nozzle 285 can be easily coupled to a flexible cover (e.g., the flexible cover 130), allowing the earbud assembly to better and more comfortably fit into the user's ear canal.

[0067] Figure 3 is a block diagram of an earbud assembly 300 according to one or more embodiments. The earbud assembly 300 can be a component of an audio system that provides audio content to a user (e.g., as discussed below with reference to FIG. 4 ). The earbud assembly 300 includes an acoustic sensor assembly 310, a speaker assembly 320, a controller 330, and a power supply assembly 340. The earbud assemblies described in the previous figures are embodiments of the earbud assembly 300. Some embodiments of the earbud assembly 300 include other components than those described herein.

[0068] The acoustic sensor assembly 310 detects sound. The acoustic sensor assembly 310 may include one or more acoustic sensors, which may be a microphone, an accelerometer, another sensor that detects acoustic pressure waves, or some combination thereof. An external acoustic sensor of the acoustic sensor assembly 310 located in an unobstructed portion of the earplug assembly 300 may detect sound from a local area around the user. An internal acoustic sensor of the acoustic sensor assembly 310 located in a portion of the earplug assembly 300 that fits within the user's ear canal may detect sound presented to the user through tissue conduction. The acoustic sensor is configured to detect acoustic pressure waves and convert the detected pressure waves into an electrical format (analog or digital).

[0069] The speaker assembly 320 presents audio content to the user according to instructions from the controller 330. The speaker assembly 320 presents the audio content to the user's ear canal based in part on the sounds detected by the acoustic sensor assembly 310. When presented by the speaker assembly 320, the detected sounds may be filtered, enhanced, amplified, or attenuated. The speaker assembly 320 may be composed of one or more speakers, such as Figure 2A-2C The speaker 220 in the embodiment of the present invention and the sound is presented by the sound pressure waves transmitted through the air. The speaker assembly 320 can be configured to present the audio content in the frequency range such as 20 Hz to 20 kHz, which is generally near the average range of human hearing.

[0070] The controller 330 processes the detected sound data and instructs the speaker assembly 320 to present the audio content. The controller 330 may instruct the speaker assembly 320 to relay the sound from the local area of ​​the user so that the user perceives the sound of a larger bandwidth and the spatial prompts of the sound presented in the local area around them. The sound pressure wave data is detected by the sound sensor assembly 310 and then sent to the controller 330. The controller 330 processes the sound data and instructs the speaker assembly 320 to present the audio content. The instructions of the controller 330 to the speaker assembly 320 may include instructions for presenting the filtered sound from the local area. For example, the controller 330 may generate a sound filter targeting a specific frequency range. The sound of these frequencies may be amplified, attenuated or enhanced, wherein the speaker assembly 520 presents the audio content accordingly. Examples of sound filters include low-pass filters, high-pass filters, and band-pass filters, etc. In some embodiments, certain frequency ranges may be amplified, retaining spatial prompts and helping users with hearing loss in those frequency ranges to better hear their environment. In other embodiments, the controller 330 may filter out the noise generated by the sound sensor in the sound sensor assembly 310. Due to the small size of the sound sensor, the sound sensor is more likely to generate noise. In some embodiments, the user's voice may be amplified due to the earplug assembly 300 blocking the ear canal. The controller 330 can attenuate the amplitude of the user's voice so that the user can hear the audio content presented by the speaker assembly 310.

[0071] The power supply assembly 340 provides power to the earbud assembly 300. In some embodiments, there are one or more power supply units for some or all of the components of the earbud assembly 300. The power supply assembly 340 can provide power to some or all of the components, such as the acoustic sensor assembly 310, the speaker assembly 320, and the data transmission assembly 330. The power supply unit is a battery. In some cases, the power supply unit is a rechargeable battery. In some embodiments, the power supply unit can be wirelessly powered (e.g., inductively powered). In these embodiments, the power supply assembly 340 can include one or more receiving coils to receive power.

[0072] The earplug assembly 300 can be used to provide audio content to a user. In some embodiments, the earplug assembly 300 can be used with a user, such as Figure 4A-4B The described artificial reality headset works in conjunction with the earbud assembly 300. For example, the earbud assembly 300 can be used to calibrate the audio system of the artificial reality headset.

[0073] Figure 4Ais a perspective view of a head mounted device 400 implemented as an eyewear device according to one or more embodiments. In some embodiments, the eyewear device is a near eye display (NED). Typically, the head mounted device 400 can be worn on a user's face such that content (e.g., media content) is presented using a display component and / or an audio system. However, the head mounted device 400 can also be used such that media content is presented to the user in a different manner. Examples of media content presented by the head mounted device 400 include one or more images, videos, audio, or some combination thereof. The head mounted device 400 includes a frame and may include, among other components, a display component including one or more display elements 420, a depth camera assembly (DCA), an audio system, and a position sensor 490. Although Figure 4A The example positioning on the head mounted device 400 shows the components of the head mounted device 400, but these components can be located elsewhere on the head mounted device 400, on a peripheral device that is paired with the head mounted device 400, or some combination of these two locations. Similarly, the components on the head mounted device 400 may be located more Figure 4A 4. The frame 410 holds the other components of the head mounted device 400. The frame 410 includes a front portion that holds one or more display elements 420 and an end piece (e.g., temple) that is attached to the user's head. The front portion of the frame 410 bridges the top of the user's nose. The length of the end piece can be adjustable (e.g., adjustable temple length) to fit different users. The end piece can also include a portion that curls behind the user's ear (e.g., temple tip, ear hook).

[0074] One or more display elements 420 provide light to a user wearing the head mounted device 400. As shown, the head mounted device includes a display element 420 for each eye of the user. In some embodiments, the display element 420 generates image light that is provided to the eyebox of the head mounted device 400. The eyebox is the spatial location occupied by the eyes when the user wears the head mounted device 400. For example, the display element 420 can be a waveguide display. The waveguide display includes a light source (e.g., a two-dimensional light source, one or more linear light sources, one or more point light sources, etc.) and one or more waveguides. Light from the light source is coupled inwardly into one or more waveguides, which output light in a manner such that a pupil replica exists in the eyebox of the head mounted device 400. The in-coupling and / or out-coupling of light from one or more waveguides can be accomplished using one or more diffraction gratings. In some embodiments, the waveguide display includes a scanning element (e.g., a waveguide, a reflector, etc.) that scans the light from the light source when it is coupled inwardly into one or more waveguides. It should be noted that in some embodiments, one or both of the display elements 420 are opaque and do not transmit light from a local area around the head-mounted device 400. The local area is the area around the head-mounted device 400. For example, the local area may be a room where the user wearing the head-mounted device 400 is located, or the user wearing the head-mounted device 400 may be outside and the local area is an external area. In this case, the head-mounted device 400 generates VR content. Alternatively, in some embodiments, one or both of the display elements 420 are at least partially transparent so that light from the local area can be combined with light from one or more display elements to produce AR and / or MR content. In some embodiments, the display element 420 does not generate image light, but rather a lens transmits light from the local area to the window. For example, one or both of the display elements 420 may be a non-corrective lens (over-the-counter), or a prescription lens (e.g., a single vision lens, a bifocal and trifocal lens, or a progressive lens) to help correct defects in the user's vision. In some embodiments, the display element 420 may be polarized and / or tinted to protect the user's eyes from sunlight.

[0075] It should be noted that in some embodiments, the display element 420 may include an additional optical block (not shown). The optical block may include one or more optical elements (e.g., lenses, Fresnel lenses, etc.) that direct light from the display element 420 to the viewing window. The optical block may, for example, correct aberrations in some or all image content, magnify some or all images, or some combination thereof.

[0076] The DCA determines depth information of a portion of a local area around the head mounted device 400. The DCA includes one or more imaging devices 430 and a DCA controller (not shown). Figure 4A), and may also include an illuminator 440. In some embodiments, the illuminator 440 illuminates a portion of the local area with light. The light may be, for example, structured light (e.g., dot patterns, strips, etc.) in infrared (IR), IR flash for time of flight, etc. In some embodiments, one or more imaging devices 430 capture an image of a portion of the local area including light from the illuminator 440. As shown in the figure, Figure 4A A single illuminator 440 and two imaging devices 430 are shown. In an alternative embodiment, there is no illuminator 440 and at least two imaging devices 430.

[0077] The DCA controller calculates depth information for a portion of the local area using the captured images and one or more depth determination techniques. The depth determination techniques may be, for example, direct time of flight (ToF) depth sensing, indirect ToF depth sensing, structured light, passive stereo analysis, active stereo analysis (using texture added to the scene by light from illuminator 440), some other technique for determining the depth of the scene, or some combination thereof.

[0078] The audio system provides audio content. The audio system includes a transducer array, a sensor array, and an audio controller 450. However, in other embodiments, the audio system may include different and / or additional components. Similarly, in some cases, the functions described with reference to the components of the audio system may be distributed between the components in a manner different from that described herein. For example, some or all functions of the controller may be performed by a remote server.

[0079] The transducer array presents sound to the user. The transducer array includes multiple transducers. The transducer can be a speaker 460 or a tissue transducer 470 (e.g., a bone conduction transducer or a cartilage conduction transducer). Although the speaker 460 is shown outside the frame 410, the speaker 460 can be enclosed in the frame 410. In some embodiments, instead of a separate speaker for each ear, the head mounted device 400 includes a speaker array that includes multiple speakers integrated into the frame 410 to improve the directionality of the presented audio content. The tissue transducer 470 is coupled to the user's head and directly vibrates the user's tissue (e.g., bone or cartilage) to generate sound. The number and / or positioning of the transducers can be different from the Figure 4A Different than shown.

[0080] The sensor array detects sounds in a local area of ​​the head mounted device 400. The sensor array includes a plurality of acoustic sensors 480. The acoustic sensors 480 capture sounds emitted from one or more sound sources in a local area (e.g., a room). Each acoustic sensor is configured to detect sounds and convert the detected sounds into an electronic format (analog or digital). The acoustic sensor 480 may be an acoustic wave sensor, a microphone, an acoustic transducer, or a similar sensor suitable for detecting sounds.

[0081] In some embodiments, one or more acoustic sensors 480 can be placed in the ear canal of each ear (e.g., acting as binaural microphones). In some embodiments, acoustic sensors 480 can be placed on an exterior surface of headgear 400, on an interior surface of headgear 400, separate from headgear 400 (e.g., part of some other device), or some combination thereof. The number and / or positioning of acoustic sensors 480 can vary depending on the device. Figure 4A For example, the number of acoustic detection positionings can be increased to increase the amount of audio information collected and the sensitivity and / or accuracy of the information. The acoustic detection positionings can be oriented so that the microphone can detect sounds in a wide range of directions around the user wearing the head mounted device 400.

[0082] The audio controller 450 processes information from the sensor array describing the sounds detected by the sensor array. The audio controller 450 may include a processor and a computer-readable storage medium. The audio controller 450 may be configured to generate a direction of arrival (DOA) estimate, generate an acoustic transfer function (e.g., an array transfer function and / or a head-related transfer function), track the location of a sound source, form a beam in the direction of a sound source, classify a sound source, generate a sound filter for the speaker 460, or some combination thereof.

[0083] Position sensor 490 generates one or more measurement signals in response to the movement of head mounted device 400. Position sensor 490 may be located on a portion of frame 410 of head mounted device 400. Position sensor 490 may include an inertial measurement unit (IMU). Examples of position sensor 490 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects movement, a type of sensor used for error correction of an IMU, or some combination thereof. Position sensor 490 may be located outside of the IMU, inside of the IMU, or some combination thereof.

[0084] In some embodiments, the head mounted device 400 can provide simultaneous localization and mapping (SLAM) of the position of the head mounted device 400 and updates of the local area model. For example, the head mounted device 400 may include a passive camera assembly (PCA) that generates color image data. The PCA may include one or more RGB cameras that capture images of some or all local areas. In some embodiments, some or all imaging devices 430 of the DCA may also be used as PCAs. The images captured by the PCA and the depth information determined by the DCA can be used to determine parameters of the local area, generate a model of the local area, update the model of the local area, or some combination thereof. In addition, the position sensor 490 tracks the position (e.g., positioning and posture) of the head mounted device 400 in the room.

[0085] Figure 4B 4 is a perspective view of a head mounted device 405 implemented as an HMD according to one or more embodiments. In embodiments describing an AR system and / or an MR system, a portion of the front side of the HMD is at least partially transparent in the visible light band (approximately 380 nm to 750 nm), and a portion of the HMD between the front side of the HMD and the user's eyes is at least partially transparent (e.g., a partially transparent electronic display). The HMD includes a front rigid body 415 and a strap 475. The head mounted device 405 includes many of the same components as described above with reference to FIG. Figure 4A The same components described above are modified to integrate with the HMD form factor. For example, the HMD includes a display assembly, a DCA, an audio system, and a position sensor 490. Figure 4B An illuminator 440 , a plurality of speakers 460 , a plurality of imaging devices 430 , a plurality of acoustic sensors 480 , and a position sensor 490 are shown.

[0086] A hear-through earbud assembly, such as earbud assembly 300, can work with headgear 400 and / or headgear 405. In some embodiments, some components of headgear 400 and / or headgear 405 can double as components of earbud assembly 300. For example, audio controller 450 can be used as controller 330 of earbud assembly 300. In some embodiments, a user can wear headgear 400 and / or headgear 405 in addition to earbud assembly 300. In another embodiment, headgear 400 and / or 405 can present visual content to the user via display element 420, which corresponds to the replayed audio content presented by earbud assembly 300.

[0087] Examples of Artificial Reality Systems

[0088] Figure 5 5 is a system 500 including a head mounted device 505 according to one or more embodiments. In some embodiments, the head mounted device 505 may be Figure 4AHead mounted device 400 or Figure 4B The system 500 may be operable in an artificial reality environment (e.g., a virtual reality environment, an augmented reality environment, a mixed reality environment, or some combination thereof). Figure 5 The system 500 shown includes a head mounted device 505, an input / output (I / O) interface 510 coupled to a console 515, a network 520, and a mapping server 525. Figure 5 An example system 500 is shown that includes one head mounted device 505 and one I / O interface 510, but in other embodiments, any number of these components may be included in the system 500. For example, there may be multiple head mounted devices, each with an associated I / O interface 510, each head mounted device and I / O interface 510 communicating with a console 515. In alternative configurations, different and / or additional components may be included in the system 500. Additionally, in some embodiments, the system 500 may be combined with a plurality of head mounted devices, each with an associated I / O interface 510, and each head mounted device and I / O interface 510 communicating with a console 515. Figure 5 The functionality described by one or more components shown may be different in combination. Figure 5 The described approach is distributed between components. For example, some or all of the functionality of console 515 can be provided by head mounted device 505.

[0089] The head mounted device 505 includes a display assembly 530, an optical block 535, one or more position sensors 540, and a DCA 545. Some embodiments of the head mounted device 505 have a Figure 5 In addition, in other embodiments, by combining Figure 5 The functionality provided by the various components described may be distributed variously among components of the head mount 505 , or captured in a separate component remote from the head mount 505 .

[0090] The display assembly 530 displays content to the user based on the data received from the console 515. The display assembly 530 displays content using one or more display elements (e.g., the display element 120). The display element can be, for example, an electronic display. In various embodiments, the display assembly 530 includes a single display element or multiple display elements (e.g., a display for each eye of the user). Examples of electronic displays include: a liquid crystal display (LCD), an organic light emitting diode (OLED) display, an active matrix organic light emitting diode display (AMOLED), a waveguide display, some other display, or some combination thereof. It should be noted that in some embodiments, the display element 120 can also include some or all of the functionality of the optical block 535.

[0091] The optical block 535 can amplify image light received from the electronic display, correct optical errors associated with the image light, and present the corrected image light to one or two windows of the head mounted device 505. In various embodiments, the optical block 535 includes one or more optical elements. Example optical elements included in the optical block 535 include: an aperture, a Fresnel lens, a convex lens, a concave lens, a filter, a reflective surface, or any other suitable optical element that affects the image light. In addition, the optical block 535 can include a combination of different optical elements. In some embodiments, one or more optical elements in the optical block 535 can have one or more coatings, such as a partially reflective coating or an anti-reflective coating.

[0092] The magnification and focusing of the image light by the optical block 535 allows the electronic display to be physically smaller, lighter, and consume less power than a larger display. In addition, the magnification can increase the field of view of the content presented by the electronic display. For example, the field of view of the displayed content is such that the displayed content uses almost all (e.g., about 110 degrees diagonally), and in some cases, all of the user's field of view to be presented. Furthermore, in some embodiments, the magnification can be adjusted by adding or removing optical elements.

[0093] In some embodiments, the optical block 535 can be designed to correct one or more types of optical errors. Examples of optical errors include barrel or pincushion distortion, longitudinal chromatic aberration, or lateral chromatic aberration. Other types of optical errors may also include spherical aberration, chromatic aberrations, or errors due to lens field curvature, astigmatism, or any other type of optical error. In some embodiments, the content provided to the electronic display for display is pre-distorted, and when the optical block 535 receives image light generated based on the content from the electronic display, the optical block corrects the distortion.

[0094] The position sensor 540 is an electronic device that generates data indicating the position of the head mounted device 505. The position sensor 540 generates one or more measurement signals in response to the movement of the head mounted device 505. The position sensor 190 is an embodiment of the position sensor 540. Examples of the position sensor 540 include: one or more IMUs, one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects movement, or some combination thereof. The position sensor 540 may include multiple accelerometers that measure translational movement (forward / backward, up / down, left / right) and multiple gyroscopes for measuring rotational movement (e.g., pitch, yaw, roll). In some embodiments, the IMU samples the measurement signals quickly and calculates the estimated position of the head mounted device 505 based on the sampled data. For example, the IMU integrates the measurement signals received from the accelerometers over time to estimate a velocity vector and integrates the velocity vector over time to determine the estimated position of a reference point on the head mounted device 505. The reference point is a point that can be used to describe the position of the head mounted device 505. Although reference points can generally be defined as points in space, in practice reference points are defined as points within the head mounted device 505.

[0095] The DCA 545 generates depth information for a portion of the local area. The DCA includes a DCA controller and one or more imaging devices. The DCA 545 may also include an illuminator. The operation and structure of the DCA 545 are described above with respect to Figure 4A Described.

[0096] The audio system 550 provides audio content to the user of the head mounted device 505. The audio system 550 is substantially the same as the audio system 200 described above. The audio system 550 may include one or more acoustic sensors, one or more transducers, and an audio controller. The audio system 550 may provide spatialized audio content to the user. In some embodiments, the audio system 550 may request acoustic parameters from the mapping server 525 via the network 520. The acoustic parameters describe one or more acoustic characteristics of a local area (e.g., room impulse response, reverberation time, reverberation level, etc.). The audio system 550 may provide information describing at least a portion of the local area from, for example, the DCA 545 and / or provide positioning information of the head mounted device 505 from the position sensor 540. The audio system 550 may generate one or more sound filters using the one or more acoustic parameters received from the mapping server 525, and use the sound filters to provide audio content to the user.

[0097] The audio system 550 also presents audio content to the user of the head mounted device 505. In some embodiments, the earplug assembly 300 may be a component of the audio system 550. In some embodiments, the audio system 550 may be calibrated using the earplug assembly 300. For example, the audio system 550 may present audio content to the user based on sounds in a local area around the user, the audio content preserving spatial cues based on the filtering of the sounds from the local area by the earplug assembly 300. The audio system 550 may present audio content to the user through air conduction and / or tissue conduction. In tissue conduction, tissue in and / or around the user's ear is vibrated to produce sound pressure waves that are perceived as sound by the cochlea of ​​the user's ear.

[0098] The I / O interface 510 is a device that allows a user to send an action request and receive a response from the console 515. An action request is a request to perform a specific action. For example, an action request can be an instruction to start or end capturing image or video data, or an instruction to perform a specific action within an application. The I / O interface 510 may include one or more input devices. Example input devices include: a keyboard, a mouse, a game controller, or any other suitable device for receiving an action request and transmitting the action request to the console 515. The action request received by the I / O interface 510 is transmitted to the console 515, and the console performs the action corresponding to the action request. In some embodiments, the I / O interface 510 includes an IMU that captures calibration data indicating an estimated position of the I / O interface 510 relative to the initial position of the I / O interface 510. In some embodiments, the I / O interface 510 can provide tactile feedback to the user according to the instruction received from the console 515. For example, tactile feedback is provided when an action request is received, or when console 515 transmits instructions to I / O interface 510 that cause I / O interface 510 to generate tactile feedback when console 515 performs the action.

[0099] The console 515 provides content to the headset 505 for processing based on information received from one or more of: the DCA 545, the headset 505, and the I / O interface 510. Figure 5 In the example shown, the console 515 includes an application store 555, a tracking module 560, and an engine 565. Some embodiments of the console 515 have a Figure 5 Similarly, the functions described further below may be implemented in different ways in combination with the modules or components described above. Figure 5 The described manner is distributed among the components of the console 515. In some embodiments, the functions discussed herein with reference to the console 515 can be implemented in the head mounted device 505 or in a remote system.

[0100] The application storage 555 stores one or more applications for execution by the console 515. An application is a set of instructions that, when executed by a processor, generates content for presentation to a user. The content generated by the application may be responsive to input received from the user via movement of the head mounted device 505 or the I / O interface 510. Examples of applications include: gaming applications, conferencing applications, video playback applications, or other suitable applications.

[0101] The tracking module 560 tracks the movement of the headset 505 or the I / O interface 510 using information from the DCA 545, one or more position sensors 540, or some combination thereof. For example, the tracking module 560 determines the location of a reference point of the headset 505 in a map of the local area based on the information from the headset 505. The tracking module 560 may also determine the location of an object or virtual object. Additionally, in some embodiments, the tracking module 560 may use portions of the data from the position sensors 540 indicating the location of the headset 505 and the representation of the local area from the DCA 545 to predict the future position of the headset 505. The tracking module 560 provides the estimated or predicted future location of the headset 505 or the I / O interface 510 to the engine 565.

[0102] The engine 565 executes the application and receives the position information, acceleration information, velocity information, predicted future position, or some combination thereof of the head mounted device 505 from the tracking module 560. Based on the received information, the engine 565 determines the content provided to the head mounted device 505 for presentation to the user. For example, if the received information indicates that the user has looked to the left, the engine 565 generates content for the head mounted device 505 that reflects (mirror) the user's movement in a virtual local area or in a local area that enhances the local area with additional content. In addition, the engine 565 performs an action within an application executed on the console 515 in response to an action request received from the I / O interface 510, and provides feedback to the user that the action has been performed. The feedback provided may be visual or auditory feedback via the head mounted device 505, or tactile feedback via the I / O interface 510.

[0103] The earbud assembly 300 provides audio content to the user. Figure 1-Figure 3As described, the earplug assembly 300 detects sound from a local area via the acoustic sensor assembly 310, processes sound data via the controller 330, and presents audio content based in part on the detected sound via the speaker assembly 320. The earplug assembly 300 is powered by the power supply assembly 340. The earplug assembly 300 can be used alone and / or in combination with the audio system 550 to provide audio content to the user of the head mounted device based in part on the sound from the local area detected by the earplug assembly 300. In some embodiments, the user can use two earplug assemblies 300, one for each ear. Each earplug assembly 300 can provide a portion of the audio content as instructed by the controller 330.

[0104] Additional configuration information

[0105] The foregoing description of the embodiments of the present disclosure is presented for illustrative purposes; it is not intended to be exhaustive or to limit the disclosure to the precise form disclosed. Those skilled in the relevant art can recognize that many modifications and variations are possible in light of the above disclosure.

[0106] Some parts of this description describe embodiments of the present disclosure from the aspect of algorithms and symbolic representations of operations on information. Technicians in the field of data processing usually use these algorithmic descriptions and representations to effectively convey the essence of their work to other technicians in the field. Although these operations are described functionally, computationally or logically, they should be understood to be implemented by computer programs or equivalent circuits, microcodes, etc. related to the manufacturing process. In addition, it is sometimes proven to be convenient to refer to these arrangements of operations as modules without loss of generality. The described operations and their related modules can be embodied in software, firmware, hardware, or any combination thereof.

[0107] Any steps, operations or processes described herein may be performed or implemented using one or more hardware or software modules alone or in combination with other devices. In one embodiment, the software modules are implemented using a computer program product including a computer-readable medium containing computer program code, which can be executed by a computer processor to perform any or all of the steps, operations or processes described (e.g., with respect to a manufacturing process).

[0108] Embodiments of the present disclosure may also relate to an apparatus for performing the operations described herein. The apparatus may be specially constructed for the desired purpose, and / or it may include a general-purpose computing device selectively activated or reconfigured by a computer program stored in a computer. Such a computer program may be stored in a non-volatile, tangible computer-readable storage medium, or any type of medium suitable for storing electronic instructions, which may be coupled to a computer system bus. In addition, any computing system mentioned in the specification may include a single processor, or may be an architecture that uses a multi-processor design to increase computing power.

[0109] Finally, the language used in the specification is selected primarily for readability and instructional purposes, and it may not be selected to describe or limit the inventive subject matter. Therefore, it is intended that the scope of the disclosure be limited not by this detailed description, but by any claims issued on an application based thereon. Therefore, the disclosure of the embodiments is intended to be illustrative, rather than restrictive, of the scope of the disclosure, which is set forth in the appended claims.

Claims

1. An earplug assembly, comprising: an acoustic sensor configured to detect sound from a local area surrounding the user; a body configured to fit at least partially within an ear canal of the user, the body configured to have a hole between an entrance to the ear canal and the acoustic sensor, the hole being an entrance to an acoustic waveguide that guides sound from the local area to an area within the body, wherein the acoustic sensor is located in the area; and A speaker is coupled to a portion of the body, the speaker being configured to present audio content within the ear canal based in part on sounds detected from the local area.

2. The earplug assembly according to claim 1, wherein: The body is partially enclosed within a flexible covering that conforms to the shape of the ear canal and seals against the ear canal.

3. The earplug assembly according to claim 1, wherein: The aperture is located between the microphone and the speaker, and the portion of the body coupled to the speaker is configured to be located within the ear canal.

4. The earplug assembly according to claim 2, wherein: The aperture is located between the microphone and the speaker, and the portion of the body coupled to the speaker is configured to be located within the ear canal.

5. The earplug assembly according to any one of claims 1 to 4, wherein: The body further comprises an additional hole, which is an additional inlet for the acoustic waveguide.

6. The earplug assembly according to any one of claims 1 to 4, further comprising an additional acoustic sensor for receiving sound from the local area, the acoustic sensor being located on a surface of the body.

7. The earplug assembly according to any one of claims 1 to 4 further comprises an additional acoustic sensor located in an area of ​​the body configured to be mounted within the ear canal; and wherein the additional acoustic sensor is located near the hole along the surface of the body, the hole being located in the area of ​​the body configured to be mounted within the ear canal.

8. The earplug assembly according to any one of claims 1 to 4, wherein: The sound from the local area is propagated to the sound waveguide through the hole located in the area of ​​the body configured to be fitted in the ear canal, and the sound is presented to the inner ear of the user.

9. The earplug assembly according to any one of claims 1 to 4, wherein: The body includes a first portion and a second portion, and the first portion is configured to be at least partially assembled in the ear canal of the user, and the second portion is configured to be located outside the ear canal, and the earplug assembly further includes: an additional acoustic sensor located within the second portion of the body; and An additional acoustic waveguide is located within the first and second portions of the body, wherein sound within the ear canal is propagated through the additional acoustic waveguide to the additional acoustic sensor.

10. The earplug assembly according to any one of claims 1 to 4, wherein: The speaker is located on the surface of the body.

11. An earplug assembly according to any one of claims 1 to 4, further comprising an additional waveguide coupling the speaker to an additional hole along the surface of the body, wherein sound from the speaker propagates through the additional waveguide and exits the additional hole into the ear canal; and wherein the additional hole is located in a portion of the body configured to fit within the ear canal.

12. The earbud assembly of any one of claims 1 to 4, further comprising a controller configured to control what audio content is presented by the speaker.

13. A method for presenting adjusted audio content, the method comprising: detecting sound from a local area surrounding the user via the earbud assembly; generating a sound filter using the sound detected from the local area; and presenting the adjusted audio content based in part on the sound filter to an ear canal of the user via the earbud assembly, wherein the earbud assembly comprises: an acoustic sensor configured to detect sound from a local area surrounding the user; a body configured to at least partially fit within the ear canal of the user, the body configured to have a hole between the entrance of the ear canal and the acoustic sensor, the hole being an entrance of an acoustic waveguide that guides sound from the local area to an area within the body, wherein the acoustic sensor is located in the area; and A speaker coupled to a portion of the body is configured to present the adjusted audio content within the ear canal based in part on sounds detected from the local area.

14. The method according to claim 13, wherein: The body is partially enclosed in a flexible covering that conforms to the shape of the ear canal and seals against the ear canal; and / or wherein the hole is located between the microphone and the entrance of the ear canal; and / or wherein the hole includes a first side and a second side, and the angle between the first side and the second side measured relative to the central axis of the body is at least 280 degrees; and / or wherein the body also includes an additional hole, which is an additional entrance to the sound waveguide.

15. The method according to claim 13 or claim 14, wherein: The sound from the local area is propagated to the sound waveguide through the hole located in the area of ​​the body configured to be fitted in the ear canal, and the sound is presented to the inner ear of the user.

Images