Methods, apparatuses, and computer program products for providing an active vibration control system

Abstract

A system and method for removing unwanted vibrational noise is provided. The system can detect, by one or more microphones of the system, at least one audio signal that includes audio content output from at least one speaker and audio data from one or more other sources or caused by the one or more other sources. The other audio data can include determined undesired vibrational noise that causes distortion of the at least one audio signal. The system can determine, by at least one sensor of the system, a subset of the other audio data based in part on determining at least one motion of a user of the system or motion of one or more other users. The system can remove or reduce the undesired vibrational noise from the at least one audio signal to enable output of sound associated with the modification of the at least one audio signal.

Description

Cross-references to related applications

[0001] This application claims priority to U.S. Provisional Application No. 63 / 592,834, filed October 24, 2023, entitled “Active Vibration Control Using Additional Sensors And Transducers,” which is incorporated herein by reference in its entirety; and also claims the benefit and priority to U.S. Non-Provisional Application No. 18 / 923,437, filed October 22, 2024. Technical Field

[0002] Exemplary aspects of this disclosure may generally relate to methods, apparatus, and computer program products for providing techniques that facilitate active vibration control methods to reduce unwanted acoustic or mechanical vibrations associated with one or more sensor devices. Background Technology

[0003] In augmented reality (AR) devices or smart glasses / smart devices, unwanted mechanical coupling or vibrational paths may exist from the presentation transducer to the microphones (mics) in the microphone array. This can be a significant issue, particularly when the device (e.g., an AR device) is used as a hearing amplification device (e.g., hearing enhancement or hearing correction glasses) to amplify ambient sound. Such unwanted mechanical coupling / vibration presented by existing systems may limit the total gain that can be provided in hearing enhancement scenarios (e.g., conversation focusing, hearing enhancement, and correction use cases).

[0004] Therefore, it may be beneficial to provide an effective and reliable mechanism that offers enhanced techniques to minimize or completely eliminate these unwanted mechanical or acoustic vibrations, which can help improve the maximum stable gain (MSG) of the device. Summary of the Invention

[0005] Some examples of this disclosure can utilize active vibration control (AVC) methods to reduce unwanted mechanical or acoustic vibrations coupled to one or more microphones in a microphone array.

[0006] In this regard, some example aspects of this disclosure may relate to one or more active vibration control systems for smart glasses and / or artificial reality systems. An active vibration control system for smart glasses may utilize transducers (e.g., moving coils or moving magnets, megaphones, or piezoelectric transducers) to generate sound for the user of the smart glasses. This could be an example where electromagnetic transducers (e.g., those with either moving coils or moving magnets) are used to generate sound. Vibrations generated by speaker-based elements can propagate to other areas of the smart glasses and may cause unwanted noise or unwanted vibrations at sensors (e.g., microphones, cameras, inertial measurement units (IMUs), etc.). In this regard, some example aspects of this disclosure may utilize one or more active vibration control systems to attenuate vibrations sensed at these sensors. Active vibration control may involve actively applying a force in a manner equal to but opposite to the force exerted by external vibrations (e.g., forces originating from speaker vibrations).

[0007] Some example aspects of this disclosure may provide one or more active vibration control systems for smart glasses and / or artificial reality systems, which may utilize one or more feedback control mechanisms to attenuate vibrations sensed at sensors such as microphones, inertial measurement units (IMUs), cameras, etc. In some example aspects, the one or more active vibration control systems may include one or more secondary sources (e.g., audio band vibrators, transducers (e.g., broadband piezoelectric transducers, bone conduction transducers, mechanical transducers, etc.)) that can be used to generate anti-vibration signals for the active vibration control system. In these example aspects of this disclosure, one or more primary sources (e.g., vibrations originating from different sources, such as speakers on the smart glasses, head movements, self-talk / self-voice, body noise, etc.) may introduce unwanted mechanical vibrations and / or acoustic noise into the smart glasses. The one or more secondary sources may be one or more transducers (e.g., audio band vibrators or transducers, such as broadband piezoelectric transducers, mechanical transducers, bone conduction transducers, etc.) that can be used to generate one or more anti-vibration signals. The one or more anti-vibration signals can counteract (e.g., eliminate or remove) unwanted vibrations originating from one or more primary sources. It should be noted that different placement of the smart glasses on the user's head may result in different frequency responses from the driver (e.g., speaker) to the microphone or IMU (e.g., accelerometer).

[0008] In one example aspect of this disclosure, a method is provided comprising: detecting at least one audio signal via at least one microphone of a device, the at least one audio signal comprising audio content output from at least one speaker and other audio data from or caused by one or more other sources, wherein the other audio data comprises determined unwanted vibration noise that causes distortion of the at least one audio signal; determining at least one subset of the other audio data via at least one sensor device of the device, at least in part based on determining at least one movement of a user of the device or the movement of one or more other users; and removing or reducing the determined unwanted vibration noise from the at least one audio signal based on the determined at least one subset of the other audio data, such that sound associated with the modification of the at least one audio signal can be output.

[0009] Optionally, the method further includes: causing a modification of the at least one audio signal output through the at least one speaker or the second speaker, wherein the modification of the at least one audio signal does not include the determined undesired vibration noise or includes a noise reduction that includes the determined undesired vibration noise.

[0010] Optionally, the method further includes: determining that the subset of the other data includes at least one of the following: the user's or one or more other users' own speech; or one or more body noises associated with one or more detected movements of one or more body parts of the user or one or more other users.

[0011] Optionally, the method further includes: determining that a subset of the other data includes one or more environmental noises associated with the background of the real-world environment in which the user is located.

[0012] Optionally, the method further includes: determining that the at least one sensor device is located within a predetermined distance of the position of the at least one microphone.

[0013] Optionally, the device includes at least one of the following: an artificial reality device; a head-mounted display; or smart glasses.

[0014] Optionally, removing or reducing the identified undesirable vibration noise includes minimizing distortion, interference, or jitter associated with one or more other sensors of the device.

[0015] Optionally, the distortion includes audio feedback.

[0016] Optionally, the at least one sensor includes at least one of the following: an inertial measurement unit; or an accelerometer.

[0017] Optionally, the at least one audio signal is associated with a conversation between the user and one or more other users.

[0018] In another example aspect of this disclosure, an apparatus is provided comprising: one or more processors; and at least one memory storing a plurality of instructions, which, when executed by the one or more processors, cause the apparatus to: detect at least one audio signal via at least one microphone of the apparatus, the at least one audio signal comprising audio content output from at least one speaker and other audio data from or caused by one or more other sources, wherein the other audio data includes determined unwanted vibration noise that causes distortion of the at least one audio signal; determine at least one subset of the other audio data via at least one sensor device of the apparatus, at least in part based on determining at least one movement of a user of the apparatus or the movement of one or more other users; and remove or reduce the determined unwanted vibration noise from the at least one audio signal based on the determined at least one subset of the other audio data, so as to enable the output of sound associated with the modification of the at least one audio signal.

[0019] Optionally, when one or more processors execute the plurality of instructions, the device is configured to: cause a modification of the at least one audio signal output through the at least one speaker or the second speaker, the modification of the at least one audio signal not including the determined unwanted vibration noise or a noise reduction including the determined unwanted vibration noise.

[0020] Optionally, when one or more processors execute the plurality of instructions, the apparatus is configured to: determine that a subset of the additional data includes one or more ambient noises associated with the background of the real-world environment in which the user is located.

[0021] Optionally, when one or more processors execute the plurality of instructions, the device is configured to determine that the at least one sensor device is within a predetermined distance of the location of the at least one microphone.

[0022] Optionally, the device includes at least one of the following: an artificial reality device; a head-mounted display; or smart glasses.

[0023] Optionally, when one or more processors execute the plurality of instructions, the device is configured to remove or reduce determined undesired vibration noise by minimizing distortion, interference, or jitter associated with one or more other sensors of the device.

[0024] Optionally, the distortion includes audio feedback.

[0025] In another example aspect of this disclosure, a method is provided, comprising: detecting at least one audio signal via at least one microphone of the device, the at least one audio signal including audio content output from at least one loudspeaker and other audio data from or caused by one or more other sources, wherein the other audio data includes determined undesired vibration noise that causes distortion of the at least one audio signal; determining at least one anti-vibration signal via at least one sensor device of the device; and applying the at least one anti-vibration signal to the determined undesired vibration noise to remove or reduce the determined undesired vibration noise from the at least one audio signal, thereby enabling the output of sound associated with the modification of the at least one audio signal.

[0026] Optionally, the at least one sensor includes at least one of the following: an audio band vibrator; or a transducer.

[0027] Additional advantages will be set forth in part in the description that follows, or may be learned through practice. These advantages will be realized and obtained through the elements and combinations particularly pointed out in the appended claims. It should be understood that, as claimed, the foregoing general description and the following detailed description are exemplary and illustrative only, and not restrictive. Attached Figure Description

[0028] The invention and the following detailed description can be further understood when read in conjunction with the accompanying drawings. Exemplary embodiments of the disclosed subject matter are shown in the drawings to illustrate the disclosed subject matter; however, the disclosed subject matter is not limited to the specific methods, compositions, and apparatuses disclosed. Furthermore, the drawings are not necessarily drawn to scale. In the drawings: Figure 1 This is a schematic diagram of an exemplary network environment based on examples of this disclosure.

[0029] Figure 2 This is a schematic diagram of an exemplary communication device according to examples of this disclosure.

[0030] Figure 3 An example of smart glasses according to an exemplary aspect of this disclosure is shown.

[0031] Figure 4 Another example of smart glasses according to an exemplary aspect of this disclosure is shown.

[0032] Figure 5 An example of an artificial reality system including a headset, according to the present disclosure, is shown.

[0033] Figure 6 An example acoustic pipeline according to an example of this disclosure is shown, which is associated with the removal of unwanted vibration noise associated with a device or system.

[0034] Figure 7 A schematic diagram of an example active vibration control system according to an example of this disclosure is shown.

[0035] Figure 8 An example flowchart illustrating an operation for removing unwanted vibration noise associated with a device or system, according to an example of this disclosure, is shown.

[0036] Figure 9 Another example flowchart illustrating an operation for removing unwanted vibration noise associated with a device or system, according to an example of this disclosure, is shown.

[0037] These accompanying drawings depict various embodiments for illustrative purposes only. Those skilled in the art will readily recognize from the following discussion that alternative embodiments of the structures and methods shown herein can be employed without departing from the principles described herein. Detailed Implementation

[0038] Some embodiments of the present disclosure will now be described more fully below with reference to the accompanying drawings, which illustrate some, but not all, of the embodiments of the present disclosure. In fact, various embodiments of the present disclosure may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Similar reference numerals refer to similar elements throughout. As used herein, according to embodiments of the present disclosure, the terms “data,” “content,” “information,” and similar terms are used interchangeably to refer to data capable of being transmitted, received, and / or stored. Furthermore, as used herein, the term “exemplary” is not intended to convey any qualitative assessment but merely to convey illustrative examples. Therefore, the use of any such terms should not be used to limit the spirit and scope of the embodiments of the present disclosure.

[0039] As defined herein, “computer-readable storage medium” means a non-transitory physical or tangible storage medium (e.g., volatile or non-volatile storage device), and “computer-readable storage medium” can be distinguished from “computer-readable transmission medium” which refers to electromagnetic signals.

[0040] As referred to herein, a virtual reality (Metaverse) can represent an immersive virtual space or immersive virtual world in which multiple devices can be used on a network where one or more social connections can (but are not required) exist between users on the network or with the environment within the virtual space or virtual world. A virtual reality or virtual reality network can be associated with: three-dimensional (3D) virtual worlds; online games (e.g., video games); one or more content items such as images, videos, and non-fungible tokens (NFTs) (where content items can be purchased, for example, using digital currency and / or other suitable currencies). In some examples, a virtual reality or virtual reality network can enable the generation and provision of immersive virtual spaces in which remote users can socialize, collaborate, learn, shop, and / or participate in various other activities within the virtual space, including through the use of augmented reality / virtual reality / mixed reality.

[0041] As noted herein, one or more unwanted vibrations, one or more undesirable vibrations, and / or unwanted noise can refer to dynamic vibrational energy in the form of sound or vibration that can be sensed by sensors in a device (e.g., smart glasses).

[0042] As referred to in this article, one’s own voice (also referred to as one’s own voice) can refer to the voice of a user / person wearing a device (e.g., smart glasses).

[0043] It will be understood that the methods and systems described herein are not limited to any particular method, component, or implementation. It will also be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting.

[0044] Exemplary System Architecture Now for reference Figure 1 , Figure 1 This is a block diagram of a system according to an exemplary embodiment. For example... Figure 1As shown, system 100 may include one or more communication devices 105, 110, 115, and 120, and network device 160. Additionally, system 100 may include any suitable network, such as network 140. In some examples, network 140 may be a virtual reality network. In other examples, network 140 may be any suitable network capable of providing content and / or facilitating communication between entities within the network or between entities associated with the network. By way of example and not limitation, one or more portions of network 140 may include ad hoc networks, intranets, extranets, virtual private networks (VPNs), local area networks (LANs), wireless LANs (WLANs), wide area networks (WANs), wireless WANs (WWANs), metropolitan area networks (MANs), a portion of the Internet, a portion of the Public Switched Telephone Network (PSTN), a cellular telephone network, or a combination of two or more of these networks. Network 140 may include one or more networks 140.

[0045] Link 150 can connect communication devices 105, 110, 115, and 120 to network 140, to network device 160, and / or to each other. This disclosure contemplates any suitable link 150. In some exemplary embodiments, one or more links 150 may include one or more wired links (e.g., Digital Subscriber Line (DSL) or Data Over Cable Service Interface Specification (DOCSIS)), one or more wireless links (e.g., Wi-Fi or Worldwide Interoperability for Microwave Access (WiMAX)), or one or more optical links (e.g., Synchronous Optical Network (SONET) or Synchronous Digital Hierarchy (SDH)). In some exemplary embodiments, one or more links 150 may each include an ad hoc network, intranet, extranet, VPN, LAN, WLAN, WAN, WWAN, MAN, a portion of the Internet, a portion of the PSTN, a cellular-based network, a satellite-based network, another link 150, or a combination of two or more such links 150. Throughout the system 100, the multiple links 150 need not all be identical. In one or more aspects, one or more first links 150 may differ from one or more second links 150.

[0046] In some exemplary embodiments, communication devices 105, 110, 115, and 120 may be electronic devices that include hardware, software, or embedded logic components, or combinations of two or more such components, and are capable of performing suitable functions implemented or supported by communication devices 105, 110, 115, and 120. By way of example and not limitation, communication devices 105, 110, 115, and 120 may be computer systems, such as desktop computers, laptop or notebook computers, netbooks, tablet computers (e.g., smart tablets), e-book readers, Global Positioning System (GPS) devices, cameras, personal digital assistants (PDAs), handheld electronic devices, cellular phones, smartphones, smart glasses, augmented / virtual reality devices, smartwatches, charging cases, or any other suitable electronic devices, or any suitable combination thereof. Communication devices 105, 110, 115, and 120 may enable one or more users to access network 140. Communication devices 105, 110, 115, and 120 enable one or more users to communicate with other users at other communication devices 105, 110, 115, and 120.

[0047] Network device 160 can be accessed directly by other components of system 100 or via network 140. By way of example and not limitation, communication devices 105, 110, 115, and 120 can access network device 160 directly or via network 140 using a web browser or a local application associated with network device 160 (e.g., a mobile social networking application, a messaging application, another suitable application, or any combination thereof). In a particular exemplary embodiment, network device 160 may include one or more servers 162. Each server 162 may be a single server or a distributed server spanning multiple computers or multiple data centers. Servers 162 can be of various types, such as, but not limited to: web servers, news servers, mail servers, messaging servers, advertising servers, file servers, application servers, exchange servers, database servers, proxy servers, another server suitable for performing the functions or processes described herein, or any combination thereof. In a particular exemplary embodiment, each server 162 may include hardware, software, or embedded logic components, or a combination of two or more such components, for performing suitable functions implemented and / or supported by server 162. In a particular exemplary embodiment, network device 160 may include one or more data repositories 164. Data repository 164 may be used to store various types of information. In a particular exemplary embodiment, the information stored in data repository 164 may be organized according to a specific data structure. In a particular exemplary embodiment, each data repository 164 may be a relational database, a columnar database, a correlation database, or other suitable database. Although this disclosure describes or illustrates specific types of databases, this disclosure contemplates any suitable type of database. A particular exemplary embodiment may provide an interface that enables communication devices 105, 110, 115, 120 and / or another system (e.g., a third-party system) to manage, retrieve, modify, add, or delete information stored in data repository 164.

[0048] Network device 160 can provide users of system 100 with the ability to communicate and interact with other users. In a particular exemplary embodiment, network device 160 can provide users with the ability to take actions on various types of items or objects supported by network device 160. In a particular exemplary embodiment, network device 160 may be able to link various entities. By way of example and not limitation, network device 160 can enable multiple users to interact with each other and receive content from other systems (e.g., third-party systems) or other entities, or allow users to interact with these entities through an application programming interface (API) or other communication channels.

[0049] It should be pointed out that, although Figure 1 A network device 160 and four communication devices 105, 110, 115 and 120 are shown, but any suitable number of network devices 160 and communication devices 105, 110, 115 and 120 may be used without departing from the spirit and scope of this disclosure. Figure 1 It is part of the system.

[0050] Exemplary communication device Figure 2 A block diagram illustrating an exemplary hardware / software architecture for a communication device (e.g., user equipment (UE) 30) is shown. In some exemplary aspects, UE 30 may be any of communication devices 105, 110, 115, and 120. In some exemplary aspects, UE 30 may be a computer system, such as a desktop computer, laptop or notebook computer, netbook, tablet computer (e.g., smart tablet), e-book reader, GPS device, camera, personal digital assistant, handheld electronic device, cellular phone, smartphone, smart glasses, augmented reality / virtual reality device, smartwatch, charging case, or any other suitable electronic device. Figure 2 As shown, UE 30 (also referred to herein as node 30) may include a processor 32, non-removable memory 44, removable memory 46, one or more speakers 43, one or more microphones 38, a keyboard 40, one or more motion sensor units (MSUs) 41, one or more transducers 45, one or more acoustic pipeline components 47, a display, touchpad and / or a display, touchpad and / or one or more user interfaces 42, a power supply 48, a global positioning system (GPS) chipset 50, and other peripheral devices 52. In some examples, one or more MSUs 41 may be one or more inertial measurement units (IMUs) or one or more accelerometers.

[0051] In examples where one or more MSUs 41 can be one or more IMUs, the one or more IMUs may include accelerometers and / or gyroscopes. In some examples, one or more MSUs 41 can be accelerometers. In some other examples, one or more MSUs 41 can be contact microphones. The accelerometers of one or more IMUs can measure / determine motion, acceleration, linear velocity, and / or position associated with multiple axes (e.g., x-axis, y-axis, z-axis, etc.) relative to a reference coordinate system. The gyroscopes of one or more IMUs can measure / determine attitude, orientation, and / or angular velocity associated with multiple axes. One or more MSUs 41 can detect one or more vibrations (e.g., acoustic vibrations and / or mechanical vibrations) associated with one or more speakers 43, one or more microphones 38, and from one or more other sources (e.g., one's own voice, body noise, etc.). Additionally, in some examples, transducers 45 (e.g., mechanical vibrator transducers) can detect one or more vibrations (e.g., audio vibrations / mechanical vibrations) associated with one or more speakers 43 and / or one or more microphones 38.

[0052] In some exemplary aspects, the display, touchpad, and / or one or more user interfaces 42 may be referred to herein as a display / touchpad / one or more user interfaces 42. The display / touchpad / one or more user interfaces 42 may include a user interface capable of presenting one or more content items and / or capturing input of one or more user interactions / actions associated with the user interface. The power supply 48 may be capable of receiving power to power the UE 30. For example, the power supply 48 may include an alternating current to direct current (AC-to-DC) converter that allows the power supply 48 to be connected / plugged into an AC outlet and / or a Universal Serial Bus (USB) port to receive power. The UE 30 may also include a camera 54. In one exemplary embodiment, the camera 54 may be a smart camera configured to sense images / video appearing within one or more bounding boxes. The UE 30 may also include communication circuitry, such as a transceiver 34 and a transmitting / receiving element 36. It will be appreciated that the UE 30 may include any sub-combination of the foregoing elements while remaining consistent with the embodiments.

[0053] Processor 32 can be a dedicated processor, a digital signal processor (DSP), multiple microprocessors, one or more microprocessors associated with a DSP core, a controller, a microcontroller, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) circuit, any other type of integrated circuit (IC), and a state machine. Generally, processor 32 can execute computer-executable instructions stored in the memory of node 30 (e.g., non-removable memory 44 and / or removable memory 46) to perform various required functions of the node. For example, processor 32 can perform signal encoding, data processing, power control, input / output processing, and / or any other function that enables node 30 to operate in a wireless or wired environment. Processor 32 can run application layer programs (e.g., a browser) and / or radio access-layer (RAN) programs and / or other communication programs. Processor 32 can also perform security operations, such as authentication, security key protocols, and / or encryption operations (e.g., at the access layer and / or application layer).

[0054] Processor 32 is coupled to its communication circuitry (e.g., transceiver 34 and transmit / receive element 36). Processor 32 can control the communication circuitry by executing computer-executable instructions to enable node 30 to communicate with other nodes via the network to which it is connected.

[0055] The transmitting / receiving element 36 can be configured to transmit signals to or receive signals from other nodes or networked devices. For example, in one exemplary embodiment, the transmitting / receiving element 36 can be an antenna configured to transmit and / or receive radio frequency (RF) signals. The transmitting / receiving element 36 can support various networks and air interfaces, such as wireless local area networks (WLANs), wireless personal area networks (WPANs), and cellular networks. In yet another exemplary embodiment, the transmitting / receiving element 36 can be configured to transmit and / or receive both RF signals and optical signals. It will be appreciated that the transmitting / receiving element 36 can be configured to transmit and / or receive any combination of wireless or wired signals.

[0056] Transceiver 34 can be configured to modulate signals to be transmitted by transmitting / receiving element 36 and demodulate signals received by transmitting / receiving element 36. As described above, node 30 can have multi-mode capabilities. Therefore, transceiver 34 can include multiple transceivers enabling node 30 to communicate via various radio access technologies (RATs), such as Universal Terrestrial Radio Access (UTRA) and Institute of Electrical and Electronics Engineers (IEEE 802.11).

[0057] Processor 32 can access information from any type of suitable memory and store data in any type of suitable memory, such as non-removable memory 44 and / or removable memory 46. For example, as described above, processor 32 can store session context in its memory (e.g., non-removable memory 44 and / or removable memory 46). Non-removable memory 44 may include random access memory (RAM), read-only memory (ROM), hard disk, or any other type of memory storage device. Removable memory 46 may include a subscriber identity module (SIM) card, memory stick, and secure digital (SD) memory card, etc. In other exemplary embodiments, processor 32 can access information from memory that is not physically located on node 30 (e.g., located on a server or home computer) and store data in that memory.

[0058] Processor 32 can receive power from power source 48 and can be configured to distribute this power to other components in node 30 and / or control power to other components in node 30. Power source 48 can be any suitable device for powering node 30. For example, power source 48 can include one or more dry cell batteries (e.g., nickel-cadmium (NiCd), nickel-zinc (NiZn), nickel metal hydride (NiMH), lithium-ion (Li-ion), etc.), solar cells, and fuel cells, etc. Processor 32 can also be coupled to GPS chipset 50, which can be configured to provide location information (e.g., longitude and latitude) about the current location of node 30. It will be appreciated that node 30 can acquire location information by any suitable location determination method while remaining consistent with the exemplary embodiment.

[0059] In some examples, one or more acoustic pipeline components 47 may contribute to acoustic feedback cancellation and / or may contribute to the removal of unwanted / undesirable vibrations (e.g., acoustic and / or mechanical vibrations) associated with a device (e.g., UE 30). In some examples, one or more acoustic pipeline components 47 may be referred to herein as one or more digital signal processors (one or more DSPs) 47. In some examples, one or more acoustic pipeline components 47 may be embodied in one or more chips or one or more processors designed to support an audio path in a device, such that audio signals can be decoded and / or amplified, etc. One or more acoustic pipeline components 47 may include one or more microphones, one or more acoustic feedback cancellers (AFCs) associated with each of the plurality of microphones, one or more feedforward processors, and / or one or more other components.

[0060] Exemplary smart glasses Figure 3 An example smart glasses 300 according to an exemplary aspect of this disclosure is shown. In some examples, the smart glasses 300 may be... Figure 5 An example of 500 artificial reality systems. Figure 3 In the example, the smart glasses 300 may include one or more vibration sensors 302 (e.g., one or more MSUs 41). The one or more vibration sensors 302 may be placed / positioned near (e.g., at a predetermined distance) the location of one or more microphones 304 (e.g., one or more microphones 38). The one or more vibration sensors 302 may detect one or more vibrations (e.g., noise) from the one or more microphones 304 that need to be eliminated (e.g., removed). In some instances, air-borne microphones may not accurately capture vibrations. In this regard, the one or more vibration sensors 302 may serve as a reference source for the amount of unwanted vibration captured by the one or more microphones 304. Unwanted vibrations detectable by the one or more vibration sensors 302 may be caused by mechanical and / or acoustic coupling from the amplifier in one or more loudspeakers 305 (e.g., one or more speakers 43) to the corresponding microphone in one or more microphones 304.

[0061] In addition to vibrations caused by drivers such as one or more megaphones 305, there may be other vibrations caused by one's own voice (e.g., the user's own voice), body noise (e.g., footsteps, body movements, glasses movement), and ambient noise. In some examples, the smart glasses 300 may utilize / implement acoustic pipelines 307 (e.g., one or more acoustic pipeline components 47) to remove one or more unwanted vibrations identified / detected by one or more vibration sensors 302, as described in more detail below.

[0062] Another example of smart glasses Figure 4 An example smart glasses 400 according to an exemplary aspect of this disclosure is shown. In some examples, the smart glasses 400 may be... Figure 5 An example of 500 artificial reality systems. Figure 4 In the example, smart glasses 400 may include one or more mechanical transducers 402 (e.g., one or more mechanical vibrator transducers, one or more bone conduction transducers, one or more piezoelectric sensors, one or more voice coils, etc.). One or more mechanical transducers 402 may detect / determine one or more vibrations (e.g., noise) at a microphone of one or more microphones 404, wherein the microphone may detect and amplify vibrational coupling from one or more amplifiers 405.

[0063] In some examples, one or more mechanical transducers 402 may be placed near one or more microphones 404 (e.g., at a predetermined distance) and / or near one or more vibration sensors 403 (e.g., one or more MSUs 41 (e.g., accelerometers)) (e.g., at a predetermined distance). One or more mechanical transducers 402 may serve as one or more secondary sources to minimize or reduce unwanted mechanically coupled vibrations and / or acoustically coupled vibrations sensed / determined by one or more vibration sensors 403 (e.g., similar to feedback active noise control (FBANC)). In examples of FBANC, sensing elements (e.g., air-conducting acoustic microphones for acoustic energy and vibration sensors for mechanical vibration conditions) may sense residual energy, and based on the residual signal (also known as the error signal), the coefficients of a digital filter may be adaptively updated in an adaptive filter architecture to create an anti-noise filter that can be fed back to the secondary sources to adaptively minimize both mechanical and acoustic signals. In some examples, the smart glasses 400 may utilize / implement acoustic pipelines 407 (e.g., one or more acoustic pipeline components 47, Figure 7The system 700 is used to remove one or more unwanted vibrations determined / detected by one or more vibration sensors 403, as described in more detail below.

[0064] Exemplary Artificial Reality System Figure 5 An example artificial reality system 500 is illustrated. The artificial reality system 500 may include a head-mounted display (HMD) 510 (e.g., smart glasses and / or augmented / virtual reality devices), which includes a frame 512, one or more displays 514, a computing device 508 (also referred to herein as a computer 508), and a controller 504. In some examples, the HMD 510 may capture one or more texts from one or more images / videos associated with a real-world environment in the field of view of one or more cameras (e.g., cameras 516, 518) of the artificial reality system 500. The HMD 510 may use the text captured from the one or more images / videos to trigger one or more actions / functions of the artificial reality system 500. The displays 514 may be transparent or translucent, allowing a user wearing the HMD 510 to view through the displays 514 to see the real world (e.g., the real-world environment) and simultaneously display visual artificial reality content to the user. HMD 510 may include one or more speakers 506 and one or more microphones 502 for providing audio content to a user. In some examples, the audio content may be audio artificial reality content. HMD 500 may also include one or more motion sensor units (one or more MSUs) 505 (e.g., one or more MSUs 41), one or more transducers 5 (e.g., one or more mechanical transducers 402), and one or more acoustic lines 507. The one or more acoustic lines 507 (e.g., one or more acoustic line components 47, acoustic lines 307, acoustic lines 407) may be implemented by HMD 510 to help remove one or more vibrations (e.g., noise) from the artificial reality system 500. HMD 510 may include one or more cameras 516, 518 for capturing images and / or video of the environment. In one exemplary embodiment, HMD 510 may include one or more cameras 518, which may be rear cameras that track the movement and / or gaze of a user's eyes.

[0065] One of the multiple cameras 516 may be a front-facing camera that captures images and / or video of the environment viewed by a user wearing the HMD 510. The one or more cameras 516 may also be referred to herein as one or more front-facing cameras 516. The HMD 510 may include an eye-tracking system to track the vergence movement of a user wearing the HMD 510. In one exemplary embodiment, one or more cameras 518 may be an eye-tracking system. In some exemplary embodiments, camera 518 may be a camera configured to observe at least one of the user's eyes to capture one or more flash images (e.g., and / or flash signals). The one or more cameras 518 may also be referred to herein as one or more rear-facing cameras 518. The HMD 510 may include a microphone of an audio device 506 to capture voice input from the user. The artificial reality system 500 may also include a controller 504, which includes a touchpad and one or more buttons. The controller 504 may receive input from the user and forward that input to a computing device 508. The controller 504 may also provide haptic feedback to one or more users. Computing device 508 can be connected to HMD 510 and controller via a wired or wireless connection. Computing device 508 can control HMD 510 and controller 504 to provide augmented reality content to one or more users and receive input from one or more users. In some example embodiments, controller 504 may be a standalone controller or integrated within HMD 510. Computing device 508 may be a standalone host computer, an onboard computer integrated with HMD 510, a mobile device, or any other hardware platform capable of providing augmented reality content to users and receiving input from users. In some exemplary embodiments, HMD 510 may include an augmented reality system / virtual reality system.

[0066] Exemplary system operation In some devices, such as cellular phones, tablets, and / or smart glasses, speakers and microphones can be integrated within the device. For example, in some cases, these devices can be used as hearing amplification or hearing correction devices. In this way, these devices can utilize microphone signals of sounds that a user might need to hear, and can amplify or amplify that sound through a speaker.

[0067] Problems can arise when speakers move and generate sound associated with the resulting vibrations (e.g., one or more acoustic and / or mechanical vibrations). These vibrations may be captured / sensed by microphones that detect the sound, and these microphones may add noise to the sound based on these vibrations, potentially degrading the overall quality of the amplified microphone signal. Such noise (e.g., vibrations) included in the sound can introduce instability, feedback, and distortion, which may prevent the application of additional amplification to the speakers. In some examples, feedback may cause the speaker output to hum, which can make it more difficult for the user to hear the expected audio clearly.

[0068] To eliminate (or minimize) unwanted acoustic or mechanical vibration coupling, some existing systems may passively improve the overall acoustic-mechanical design (e.g., dipole transducer design, placing the microphone in a location where the mechanical or acoustic energy from one or more amplifiers is zero (e.g., a region with minimal energy content), isolating the microphone with damping materials, etc.).

[0069] However, some example aspects of this disclosure may provide methods and techniques for reducing unwanted acoustic and / or mechanical vibrations coupled to one or more microphones (e.g., associated with a microphone array) using active vibration control methods.

[0070] For reference Figure 6 , Figure 6 A schematic diagram illustrating an example acoustic pipeline according to an exemplary aspect of this disclosure is provided. The acoustic pipeline 600 (e.g., one or more acoustic pipeline components 47) can help remove and / or minimize unwanted vibrations (e.g., acoustic / mechanical vibrations, noise, etc.) associated with a device (e.g., smart glasses 300, artificial reality system 500). It is contemplated that processing of the acoustic pipeline 600 may be performed on one or more chips or processors created to support an audio path within the device, such that audio signals can be decoded and / or amplified, etc. In some example aspects, the acoustic pipeline 600 may be embodied within the device (e.g., smart glasses 300, artificial reality system 500).

[0071] The acoustic pipeline 600 may include at least one output voltage source 602, one or more loudspeakers (e.g., one or more loudspeakers 604), one or more microphones (e.g., one or more microphones 610), at least one device-to-microphone device 606, at least one driver-to-MSU device 608, at least one MSU 612 (e.g., one or more accelerometers), at least one feedforward processor 614, and at least one acoustic echo cancellation (AEC) device 618. exist Figure 6 In this example, the device can capture sound / audio via one or more microphones 610, and this sound / audio can also be detected by one or more components of the acoustic pipeline 600, and can be presented / output by one or more speakers 604. Figure 6 In the example, some sounds / audio output by one or more speakers 602 (e.g., a conversation between the user of the device and one or more other users) can be captured / heard by the ears of a user associated with the device (e.g., a user wearing an artificial reality system 500 or smart glasses 300). Furthermore, some sounds / audio can be coupled back to one or more microphones 610, which can cause feedback associated with the device (e.g., a buzzing noise). Additionally, other items of the sound's audio, such as noise from the user's voice (e.g., their own voice 603), as well as body noise (one or more body noises 605) (e.g., footsteps, tapping, rapid movement / motion of one or more users, etc.) and ambient noise (e.g., ambient noise 601) (e.g., background noise (e.g., other people talking in the background, birdsong, music playing, etc.)), can be coupled back to one or more microphones 610. These other items of the sound / audio (e.g., noise) may be unwanted / undesirable audio, and the acoustic pipeline 600 can minimize these unwanted / undesirable audios to reduce or eliminate acoustic feedback at one or more microphones 610. The audio noise can be associated with detected vibrations (e.g., motion, movement that causes audio, or the user's own voice detected by an accelerometer (e.g., one or more MSU 612)). In some examples, tapping can include, but is not limited to, tapping on a device (e.g., smart glasses 300, artificial reality system 500) or tapping on that device, such as voluntary or involuntary tapping / touching of the device that can be sensed by one or more microphones (e.g., one or more microphones 610).

[0072] For example, one or more MSUs 612 can detect unwanted noise (e.g., vibration), such as one or more body noises associated with the user (e.g., body noise 605) and other noises associated with the user and / or other users, such as the user's footsteps, walking, running, tapping, moving, or the user's own voice (e.g., self-voice 603). In some examples, the accelerometers of one or more MSUs 612 can determine body noise associated with the user's body or body parts and / or other users' bodies based on motion / movement detected by the user and other users. For example, when a user speaks, their vocal tract can produce speech through mechanical vibrations that can be detected by sensitive accelerometers such as contact microphones. These vibrations can propagate through the body and can be sensed by these MSUs (e.g., sensitive accelerometers and / or contact microphones). This unwanted noise (e.g., vibration) may impair the actual audio / sound that the user expects to hear from the device (e.g., artificial reality system 600, smart glasses 300) (e.g., amplification / enhancement of one or more user conversations, other audio content in the environment (e.g., office, restaurant, etc.) (e.g., desired music)).

[0073] Furthermore, in some examples, this unwanted noise (e.g., vibration) may unintentionally affect other sensors of the device. For instance, in instances where unwanted vibration may exceed a predetermined threshold, this excessive unwanted vibration may affect other sensors of the device, such as one or more cameras (e.g., camera 516, camera 518, camera 54) that capture images / one or more videos and / or associated audio. This effect may cause jitter in the captured images / one or more videos and the associated audio captured by the cameras. In some examples, jitter may cause distortion in the accuracy and / or resolution of one or more images / one or more videos and / or associated audio, and may cause delays in the device's output of one or more images / one or more videos and audio. Therefore, the device can implement acoustic pipeline 600 to remove or minimize detected unwanted vibrations (e.g., noise) so that unwanted vibrations (e.g., noise) do not undesirably skew the information (e.g., audio, video, images, etc.) captured by the device's sensors (e.g., one or more microphones 610, cameras 516, 518, 54, one or more MSUs 41, one or more MSUs 612, etc.).

[0074] exist Figure 6In the example, the output voltage source 602 can drive or power the acoustic line 600. For example, the output voltage source 602 can power one or more speakers 602, one or more microphones 610, one or more feedforward processors 614, and one or more AEC devices 618, as well as other components.

[0075] One or more driver-to-microphone devices 606 can capture sound / audio from one or more speakers 604 to one or more microphones 610, for example, through air and through structures such as devices. One or more driver-to-MSU devices 608 can capture sound / audio from one or more speakers 604 to one or more MSUs 612 (e.g., accelerometers), for example, through air and structures (e.g., devices). As described above, in addition to the sound / audio from one or more speakers 604 captured by one or more microphones 610 (e.g., through one or more driver-to-microphone devices 606), the one or more microphones 610 can also capture audio / sound from other sources in the environment (e.g., real-world environments such as scenarios of user conversations). In some instances, this sound / audio from other sources may distort the sound / audio (e.g., conversations, etc.) from one or more speakers 604 that the user of the device might want to hear with one or both ears. The sound / audio may originate from other sources, such as ambient noise 601 (e.g., one or more background noises, etc.) detected / captured by one or more microphones 610 and / or the user's own speech 603 captured / detected by one or more microphones 610. In some examples, some or all of the ambient noise 605 may be output from one or more microphones 610 to, for example, output terminal 611.

[0076] Additionally, one or more MSUs 612 can detect the user's own speech 603 and one or more body noises 605 associated with the user of the device. In some examples, one or more MSUs 612 can detect the user's own speech based on detecting / determining that the user is speaking, which is based on the rhythmic movement of the determined user's mouth. As mentioned above, in some examples, the user's own speech can be captured by an accelerometer (e.g., mechanical vibrations propagating from the user's vocal tract to other parts of the body, such as the face). One or more MSUs 612 can also determine one or more body noises 605. One or more MSUs 612 can determine one or more body noises 605 based on determining one or more movements / motions of the user's body parts (e.g., acceleration in one or more determined directions (e.g., x-axis, y-axis, z-axis)). In some other examples, one or more MSUs 612 can determine one or more body noises 605 based on determining one or more movements / motions of body parts of other users in the vicinity of the user's environment.

[0077] One or more MSUs 612 may provide one or more feedforward processors 614 with both detected self-speech 603 and one or more body noises 605. The one or more feedforward processors 614 may subtract the self-speech 603 and one or more body noises 605 (e.g., one or more unwanted vibration noises) from an audio / sound signal 607 received from one or more speakers 604. The one or more feedforward processors 614 may be a path device providing an audio signal 609 obtained by subtracting the self-speech 603 and one or more body noises 605 from the audio / sound signal 607, which will be provided to an output 611. In examples of speech enhancement, conversation focusing, and hearing amplification, the one or more feedforward processors 614 may also add digital gain to further amplify the output before presenting the signal 619 to one or more users. In some examples, the one or more feedforward processors 614 may implement one or more DSP applications and / or DSP algorithms to add digital gain to further amplify the output before presenting the signal 619 to one or more users.

[0078] One or more AEC devices 618 can detect one or more echo signals from the audio / sound signal 607 and remove these echo signals from the audio / sound signal 607 to provide an echo-free or echo-reduced audio signal 615 to the output 617. In this way, the user of the device may not hear some or all of the echo signals associated with the audio / sound signal 607.

[0079] Output 617 can receive some or all of the ambient noise 601 and audio signal 609 from output 611, and can receive audio signal 615 from one or more AEC devices 618 to generate an output audio signal 619, which may be free of (e.g., lacking) unwanted vibration noise (e.g., self-speech 603 and one or more body noises 605). In some examples, the purpose of system 600 may be to provide an enhanced version of the acoustic scene (e.g., using acoustic beamforming techniques and being noise-free to the user). As described above, in these examples of speech enhancement, conversation focusing, and hearing amplification, one or more feedforward processors 614 may also (e.g., by implementing DSP applications / algorithms) add digital gain to further amplify the output before presenting signal 619 to one or more users.

[0080] For reference Figure 7 , Figure 7 A schematic diagram illustrating an example active vibration control system according to this disclosure is provided. System 700 may include one or more speakers 702 (e.g., loudspeakers) capable of generating audio / sound for a user associated with a device (e.g., smart glasses 400, artificial reality system 500). In some examples, system 700 may be Figure 4 An example of acoustic conduit 407. One or more loudspeakers 702 can be one or more sources of one or more unwanted vibrations 704. Additionally, other sources (e.g., one's own voice, one or more body noises) can be sources of one or more unwanted vibrations 704. One or more microphones 706 can sense / detect one or more unwanted vibrations 704. One or more secondary sources 710 can generate one or more anti-noise signals y(n) (e.g., one or more anti-vibration signals) that can be used by system 700 to cancel, remove, or minimize one or more unwanted vibrations 704. In some examples, one or more secondary sources 710 can be one or more audio band vibrators or one or more transducers (e.g., one or more broadband piezoelectric transducers, one or more miniaturized bone conduction vibrators, one or more mechanical vibrator transducers, or other transducers). In some examples, one or more secondary sources 710 can be... Figure 4 Examples of one or more vibration sensors 403.

[0081] One or more noise-resistant signals y(n) can be determined / calculated by filtering the estimated value of the reference signal x(n) in the digital vibration control filter W(Z). This can be achieved by continuously adjusting the given signals x(n) and e(n) using the Filtered-XLeast Mean Square (LMS) method / technique. The e(n) signal can be an error signal. In adaptive noise control (ANC), the goal is to minimize the error signal e(n) using an adaptive method. The characteristics and coefficients of the digital vibration control filter W(Z) can be adaptively updated using an FxLMS filter. To provide destructive superposition, the one or more noise-resistant signals y(n) determined by the digital vibration control filter W(Z) can be inverted by one or more secondary sources 710 before being emitted by them. The one or more secondary sources 710 can invert one or more inverse noise-resistant signals y(n). s (n) Output along path S(Z) to cancel out one or more unwanted vibrations 704 at one or more microphones 706. For example, the anti-noise signal may be the inversion of the detected initial noise signal, and when the anti-noise signal is added to the initial noise signal, the result may be 0 (e.g., the unwanted initial noise signal is eliminated). In this respect, one or more microphones 706 may capture audio (e.g., one or more audio signals) without or with the absence (e.g., removal) of one or more unwanted vibrations 704. This audio with the unwanted vibrations 704 removed can make the user of a device (e.g., smart glasses 400, artificial reality system 500) hear clearer (e.g., less distorted) audio.

[0082] An FxLMS filter can be used in system 700 because, due to the presence of the secondary path S(Z), the error signal may not be correctly aligned in time with the estimated / determined value of the reference signal x(n). To address the issue of the error signal not being correctly aligned in time with the determined value of the reference signal x(n), an estimated secondary path filter can be placed in the path of the reference signal x(n). (Z) This secondary path filter (Z) This can be achieved / determined through the filtered X LMS. The filtered X LMS determined by the FxLMS filter can adaptively update the weights of the control filter W(Z).

[0083] In another example aspect of this disclosure, one or more motion sensor units (one or more MSUs) 708 (e.g., one or more MSUs 41, one or more vibration sensors 302, such as one or more audio band accelerometers, etc.) can be used to actively sense vibrations associated with a device (e.g., smart glasses 400, artificial reality system 500). One or more MSUs 708 can be placed / positioned in one or more areas near one or more microphones 706 to precisely capture unwanted vibrations 704 at these areas (e.g., critical areas). In some examples, critical areas may be areas within the smart glasses where sensors (e.g., microphones, cameras, IMUs, eye-tracking sensors, etc.) are placed / positioned. One or more motion sensor units 708 and / or one or more microphones 706 can sense one or more unwanted vibrations 704 (e.g., one or more signals e(n)) and can determine estimates of secondary paths (e.g., S(Z)).

[0084] Based on one or more estimates of the determined secondary path (e.g., S(Z)), an FxLMS application (e.g., an FxLMS filter) can be used to adaptively estimate and minimize, remove or eliminate one or more unwanted vibrations 704 (e.g., one or more signals e(n)) sensed in areas / locations near one or more microphones 706.

[0085] Figure 8 An example flowchart illustrating an operation for removing or reducing unwanted vibration noise according to an example of this disclosure is shown. In operation 800, a device (e.g., smart glasses 300, artificial reality system 500) can detect at least one audio signal via at least one microphone of the device (e.g., one or more microphones 304, one or more microphones 502, one or more microphones 610), the at least one audio signal comprising audio content output from at least one speaker (e.g., one or more loudspeakers 305, one or more loudspeakers 506, one or more loudspeakers 604) and other audio data from or caused by one or more other sources. The other audio data may include identified undesired vibration noise that causes distortion of the at least one audio signal.

[0086] In operation 802, the device (e.g., smart glasses 300, artificial reality system 500) can determine at least one subset of the additional audio data in part based on determining at least one movement of the user of the device or the movement of one or more other users through at least one sensor device of the device (e.g., one or more vibration sensors 302, one or more MSUs 505, one or more MSUs 612).

[0087] In operation 804, a device (e.g., smart glasses 300, artificial reality system 500) may remove or reduce determined unwanted vibration noise from the at least one audio signal based on at least one subset of the determined other audio data, so as to enable the output of sound associated with the modification of the at least one audio signal.

[0088] Figure 9 Another example flowchart illustrating an operation for removing or reducing unwanted vibration noise according to an example of this disclosure is shown. In operation 900, a device (e.g., smart glasses 400, artificial reality system 500) can detect at least one audio signal via at least one microphone of the device (e.g., one or more microphones 404, one or more microphones 502, one or more microphones 706), the at least one audio signal comprising audio content output from at least one speaker (e.g., one or more loudspeakers 405, one or more loudspeakers 506, one or more loudspeakers 702) and other audio data from or caused by one or more other sources. The other audio data may include determined undesired vibration noise (e.g., one or more unwanted vibrations 704) that cause distortion of the at least one audio signal.

[0089] In operation 902, the device (e.g., smart glasses 400, artificial reality system 500) can determine at least one anti-vibration signal (e.g., anti-noise signal y(n)) through at least one sensor device of the device (e.g., one or more mechanical transducers 402, one or more transducers 5, one or more secondary sources 710). In operation 904, the device (e.g., smart glasses 400, artificial reality system 500) can apply the at least one anti-vibration signal to the determined undesired vibration noise to remove or reduce the determined undesired vibration noise from the at least one audio signal, thereby enabling the output of sound associated with the modification of the at least one audio signal.

[0090] Alternative embodiments The foregoing description of the embodiments has been presented for illustrative purposes; it is not intended to be exhaustive or to limit the patent right to the precise form disclosed. Those skilled in the art will understand that many modifications and variations are possible in light of the foregoing disclosure.

[0091] Several embodiments are described in parts of this specification in terms of the application and symbolic representation of operations on information. These descriptions and representations are commonly used by those skilled in the art of data processing to effectively communicate the substance of their work to others skilled in the art. Although these operations are described functionally, computationally, or logically, they are understood to be implemented by computer programs or equivalent circuits, or microcode, etc. Furthermore, it has been shown that it is sometimes convenient to arrange these operations as modules without loss of generality. The described operations and their associated components can be embodied in software, firmware, hardware, or any combination thereof.

[0092] Any step, operation, or process described herein may be performed or implemented using one or more hardware or software components, individually or in combination with other devices. In one embodiment, a software component is implemented using a computer program product comprising a computer-readable medium containing computer program code that can be executed by a computer processor to perform any or all of the described steps, operations, or processes.

[0093] The embodiments may also relate to means for performing the operations described herein. Such means may be specifically constructed for the desired purpose, and / or may include a computing device selectively activated or reconfigured by a computer program stored in a computer. Such a computer program may be stored in a non-transitory tangible computer-readable storage medium, or in any type of medium suitable for storing electronic instructions, which may be coupled to a computer system bus. Furthermore, any computing system mentioned herein may include a single processor, or may employ a multiprocessor design to achieve increased computing power.

[0094] Embodiments may also relate to products generated by the computational processes described herein. Such products may include information generated by the computational processes, wherein the information is stored on a non-transitory tangible computer-readable storage medium, and such products may include any embodiment of the computer program products or other combinations of data described herein.

[0095] Finally, the wording used in this specification has been chosen primarily for readability and instruction purposes and may not have been selected to define or limit the subject matter of the invention. Therefore, the scope of the patent right is not limited by this specific embodiment, but rather by any of the claims published in this application. Thus, the disclosure of the embodiments is intended to illustrate, rather than limit, the scope of the patent right set forth in the appended claims.

Claims

1. A method comprising: At least one audio signal is detected by at least one microphone of the device, the at least one audio signal comprising audio content output from at least one speaker and other audio data from or caused by one or more other sources, wherein the other audio data includes determined undesired vibration noise that causes distortion of the at least one audio signal; Using at least one sensor device of the device, at least one subset of the other audio data is determined, based at least in part on determining at least one movement of the user of the device or the movement of one or more other users; and Based on the determined subset of the other audio data, the determined unwanted vibration noise is removed or reduced from the at least one audio signal so that the sound associated with the modification of the at least one audio signal can be output.

2. The method according to claim 1 further includes: The modification of the at least one audio signal output through the at least one speaker or the second speaker, wherein the modification of the at least one audio signal does not include the determined unwanted vibration noise or includes a noise reduction that includes the determined unwanted vibration noise; and Optionally, the at least one audio signal is associated with a conversation between the user and one or more other users.

3. The method according to claim 1 further includes: The subset of the other data includes at least one of the following: the user's or one or more other users' own speech; or one or more body noises associated with one or more detected movements of one or more body parts of the user or one or more other users; and / or The subset of the other data is determined to include one or more environmental noises associated with the background of the real-world environment in which the user is located.

4. The method according to claim 1 further includes: Determine that the at least one sensor device is located within a predetermined distance of the position of the at least one microphone.

5. The method according to claim 1, wherein, The device includes at least one of the following: an artificial reality device; a head-mounted display; or smart glasses.

6. The method according to claim 1, wherein: Removing or reducing the identified undesired vibration noise includes minimizing distortion, interference, or jitter associated with one or more other sensors of the device; and Optionally, the distortion includes audio feedback.

7. The method according to claim 1, wherein, The at least one sensor includes at least one of the following: an inertial measurement unit; or an accelerometer.

8. An apparatus comprising: One or more processors; as well as At least one memory storing instructions that, when executed by the one or more processors, cause the device to: At least one audio signal is detected by at least one microphone of the device, the at least one audio signal comprising audio content output from at least one speaker and other audio data from or caused by one or more other sources, wherein the other audio data includes determined undesired vibration noise that causes distortion of the at least one audio signal; At least one subset of the other audio data is determined, at least in part, based on at least one movement of the user of the device or the movement of one or more other users, using at least one sensor device of the device; as well as Based on the determined subset of the other audio data, the determined unwanted vibration noise is removed or reduced from the at least one audio signal so that the sound associated with the modification of the at least one audio signal can be output.

9. The apparatus according to claim 8, wherein, When the one or more processors execute the instructions, the device is configured to: The modification of the at least one audio signal output through the at least one speaker or the second speaker, wherein the modification of the at least one audio signal does not include the determined unwanted vibration noise or includes noise reduction of the determined unwanted vibration noise.

10. The apparatus according to claim 8, wherein, When the one or more processors execute the instructions, the device is configured to: The subset of the other data includes at least one of the following: the user's or one or more other users' own speech; or one or more body noises associated with one or more detected movements of one or more body parts of the user or one or more other users; and / or The subset of the other data is determined to include one or more environmental noises associated with the background of the real-world environment in which the user is located.

11. The apparatus according to claim 8, wherein, When the one or more processors execute the instructions, the device is configured to: Determine that the at least one sensor device is located within a predetermined distance of the position of the at least one microphone.

12. The apparatus according to claim 8, wherein, The device includes at least one of the following: an artificial reality device; a head-mounted display; or smart glasses.

13. The apparatus according to claim 8, wherein, When the one or more processors execute the instructions, the device is configured to: The removal or reduction of the identified undesired vibration noise is performed by minimizing the distortion, interference, or jitter associated with one or more other sensors of the device; and Optionally, the distortion includes audio feedback.

14. A method comprising: At least one audio signal is detected by at least one microphone of the device, the at least one audio signal comprising audio content from at least one speaker and other audio data from or caused by one or more other sources, wherein the other audio data includes determined undesired vibration noise that causes distortion of the at least one audio signal; At least one vibration resistance signal is determined by at least one sensor device of the device; and The at least one anti-vibration signal is applied to the determined unwanted vibration noise to remove or reduce the determined unwanted vibration noise from the at least one audio signal, thereby enabling the output of sound associated with the modification of the at least one audio signal.

15. The method according to claim 14, wherein, The at least one sensor includes at least one of the following: an audio frequency band vibrator; or a transducer.

Images