Vibration-based directional synthetic ambient sound generation in space

Abstract

To produce vibration-based directional synthetic ambient sound in space.SOLUTION: A system includes a vibration detector to detect a location of vibration and identify a frequency of the vibration. The system also includes a controller to generate audio corresponding to the frequency of vibration detected by the vibration detector, and one or more speakers configured to provide the audio as directional sound.SELECTED DRAWING: Figure 2

Description

[Background technology]

[0001] Exemplary embodiments relate to the art of sound generation, and in particular to vibration-based directional synthetic ambient sound generation in space.

[0002] Ambient sound refers to the sounds present in a scene or place. In nature, for example, the sounds of birds, rustling leaves, or waterfalls represent ambient sound. In cities, traffic noise represents ambient sound. Humans detect ambient sound through vibrations in the air. For example, wind causes leaves to vibrate (i.e., rustle), and these vibrations are perceived as ambient sound. For example, in space or on the moon, there is no medium through which sound can travel (i.e., sound waves cannot travel in space or on the moon). Therefore, astronauts do not receive audible signals from their surroundings in the form of ambient sound. Summary of the Invention [Means for solving the problem]

[0003] In one embodiment, the system includes a vibration detector for detecting a location of the vibration and identifying a frequency of the vibration, a controller for generating a sound corresponding to the frequency of the vibration detected by the vibration detector, and one or more speakers configured to provide the sound as a directional sound.

[0004] Additionally or alternatively, in this or other embodiments, the system resides on or in an atmospheric pressure suit configured for a space environment.

[0005] Additionally or alternatively, in this or other embodiments, the speaker or speakers are within the helmet of the atmospheric suit.

[0006] Additionally or alternatively, in this or other embodiments, the one or more speakers are an array of four or more speakers arranged around a volume within the helmet.

[0007] Additionally or alternatively, in this or other embodiments, the array of four or more speakers and the vibration detector have a fixed positional relationship.

[0008] Additionally or alternatively, in this or other embodiments, the one or more speakers are in headphones.

[0009] Additionally or alternatively, in this or other embodiments, the vibration detector is part of an image sensor that includes a three-dimensional camera.

[0010] Additionally or alternatively, in this or other embodiments, the vibration detector is a three-dimensional laser Doppler vibrometer.

[0011] Additionally or alternatively, in this or other embodiments, the controller generates sound as a synthetic ambient sound corresponding to the frequency of the vibrations.

[0012] Additionally or alternatively, in this or other embodiments, the controller generates the sound based on a mapping between vibration frequencies and sounds or based on machine learning.

[0013] In another embodiment, a method includes attaching a vibration detector to an atmospheric pressure suit for a space environment. The vibration detector detects a location of vibrations and identifies a frequency of the vibrations. The method also includes disposing a controller coupled to the vibration detector to generate audio corresponding to the frequency of the vibrations detected by the vibration detector, and disposing one or more speakers in the atmospheric pressure suit to receive the audio from the controller and provide the audio as directional sound to a wearer of the atmospheric pressure suit.

[0014] Additionally or alternatively, in this or other embodiments, the placement of the speaker or speakers is within the helmet of the atmospheric suit.

[0015] Additionally or alternatively, in this or other embodiments, the arrangement of the one or more speakers is as an array of four or more speakers arranged around a volume within the helmet.

[0016] Additionally or alternatively, in this or other embodiments, positioning the array of four or more speakers includes establishing a fixed positional relationship with the vibration detector.

[0017] Additionally or alternatively, in this or other embodiments, the placement of the speaker or speakers is in headphones.

[0018] Additionally or alternatively, in this or other embodiments, the method also includes attaching an image sensor including a vibration detector and a three-dimensional camera.

[0019] Additionally or alternatively, in this or other embodiments, the vibration detector mounting is as a three-dimensional laser Doppler vibrometer.

[0020] Additionally or alternatively, in this or other embodiments, the method also includes configuring the controller to generate a sound as a synthetic ambient sound corresponding to the frequency of the vibration.

[0021] Additionally or alternatively, in this or other embodiments, the method also includes configuring the controller to generate the sound based on a mapping between frequencies of the vibrations and sounds or based on machine learning.

[0022] The following description should not be considered limiting in any way.With reference to the accompanying drawings, like elements are numbered alike. [Brief explanation of the drawings]

[0023] [Figure 1] 1 illustrates aspects of an atmospheric pressure suit with a helmet that provides vibration-based directional ambient sound generation, according to one or more embodiments. [Figure 2] 1 is a system for vibration-based directional synthetic ambient sound generation in space, according to one or more embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0024] A detailed description of one or more embodiments of the disclosed apparatus and methods is presented herein by way of example, and not limitation, with reference to the drawings.

[0025] As previously mentioned, astronauts in the space and lunar environment cannot hear ambient sounds. On the lunar surface, typical sources of ambient sounds include loose soil on which an astronaut walks or rolling rocks. Ambient sounds can provide situational awareness and can also provide warnings. For example, an ambient sound depicting a large rock rolling toward an astronaut can serve as a warning to move out of the way.

[0026] Embodiments of the systems and methods detailed herein relate to vibration-based directional synthetic ambient sound generation in space. The ambient sound is synthetically generated based on vibrations detected in the environment. The ambient sound is presented to the astronaut as directional sound to facilitate situational awareness as if the astronaut were in an environment where the ambient sound could be heard. That is, the generated ambient sound is what would be heard if there was a medium through which sound could be transmitted. One or more sensors are used to detect vibrations in the environment. These vibrations are used to generate synthetic ambient sound heard by the astronaut, which is presented as directional sound, as will be described in further detail.

[0027] FIG. 1 illustrates aspects of an atmospheric pressure suit 100 with a helmet 110 that provides vibration-based directional ambient sound generation, according to one or more embodiments. The atmospheric pressure suit 100 may be, by way of example, an extravehicular mobility unit (EMU) used in space applications. The helmet 110 provides a volume 115 ( FIG. 2 ) for accommodating the head of a wearer of the atmospheric pressure suit 100. The helmet 110 includes an internal canopy that maintains the gas in the atmospheric pressure suit 100 to create a life-sustaining environment for the wearer. As detailed in FIG. 2 , the helmet 110 may include one or more speakers 210 that output audio simulating ambient sounds that cannot actually be heard in a space environment. The one or more speakers 210 provide directionality to the audio.

[0028] 2 illustrates a system 200 for vibration-based directional synthetic ambient sound generation in space, according to one or more embodiments. A cross-sectional view of the helmet 110 is shown so that the array of speakers 210 is exposed. According to an alternative exemplary embodiment, directional earphones may be worn by the astronaut within the atmospheric suit 100. The sensor 220 includes a vibrometer (e.g., a three-dimensional laser Doppler vibrometer) that detects vibrations. The system 200 may also include a camera that facilitates identification and tracking of objects (e.g., a rolling rock) using known image processing techniques. The sensor 220 may include a three-dimensional camera supporting six degrees of freedom (6Dof).

[0029] The vibrometer and camera are collectively referred to as image sensors 225. Because system 200 generates directional sound, the field of view of sensor 220, which may be comprised of an array of image sensors 225, is 360 degrees and spans a range of elevation angles. That is, adjacent image sensors 225 may have overlapping fields of view such that a sensor 220 with an array of image sensors 225 is coupled to atmosphere suit 100 and detects vibrations at distinct relative locations in the environment surrounding atmosphere suit 100. Based on the location of sensors 220, multiple sensors 220 can be used to sense vibrations throughout the astronaut's environment (e.g., vibrations on the lunar surface beneath the astronaut's feet, vibrations caused by a rock rolling toward the astronaut). One or more sensors 220 (e.g., one or more arrays of image sensors 225) provide vibration frequency and position information to controller 230.

[0030] The controller 230 determines an audio signal representing an ambient sound corresponding to the frequency of the vibration (i.e., a synthetic ambient sound). The controller 230 may, for example, use a mapping of a range of frequencies of the vibration to the frequency (i.e., pitch) of the audio signal. According to an alternative embodiment, the controller 230 may learn an Earth-based correspondence between the vibration and audio output in a machine learning process to determine a synthetic ambient sound corresponding to the detected vibration. That is, because on Earth, vibrations are carried by the air medium to generate sound waves, the correspondence between vibration and sound can be used in a supervised learning process. The sensor 220 and the controller 230 together represent a directional sound generating system 235.

[0031] According to other alternative embodiments, the same sound can be generated for any vibration, or a synthetic, non-ambient sound can be generated based on the frequency of the vibration. The movement of the vibration can be a factor in determining the non-ambient sound (e.g., an alarm sound). For example, if the location of the vibration is moving toward the sensor 220 of the atmospheric pressure suit 100 (e.g., as in the rolling rock scenario shown in FIG. 2), a synthetic sound can reflect that the situation requires immediate attention from the wearer of the atmospheric pressure suit 100.

[0032] As previously mentioned, the directionality of the vibrations that cause the generation of ambient sound provides additional situational awareness to the wearer of atmospheric pressure suit 100. Reference points 215 are shown on helmet 110 and sensor 220. The relationship between helmet 110 and sensor 220, and therefore their respective reference points 215, is fixed. As a result, the location of the vibrations relative to sensor 220, which is one piece of information provided to controller 230, corresponds to the location of the ambient sound within helmet 110. As previously mentioned, an array of speakers 210 can be used to generate directional sound, or directional headphones can be worn by the astronaut, for example.

[0033] 2, a rolling rock on the left side of helmet 110 is the source of the vibrations detected by sensor 220. As a result, controller 230 generates ambient sound and plays it through speaker 210x on the left side of helmet 110, as shown. Thus, the wearer of atmospheric pressure suit 100 is easily alerted not only to the presence of the activity, but also to its relative location.

[0034] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Furthermore, it should be understood that the terms "comprises" and / or "comprising," when used herein, specify the presence of stated features, details, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, details, steps, operations, elements, components, and / or groups thereof.

[0035] While the present disclosure has been described with reference to one or more exemplary embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the disclosure. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the disclosure without departing from essential scope thereof. Therefore, it is not intended that the disclosure be limited to the particular embodiment disclosed as the best mode contemplated for carrying out the disclosure, but rather that the disclosure will include all embodiments falling within the scope of the appended claims.

Claims

1. a vibration detector configured to detect a location of a vibration and identify a frequency of the vibration; a controller configured to generate a sound corresponding to the frequency of vibration detected by the vibration detector; one or more speakers configured to provide the audio as directional sound; A system comprising: the system is on or in an atmospheric pressure suit configured for a space environment; system.

2. The system of claim 1 , wherein the one or more speakers are in a helmet of the atmospheric suit.

3. The system of claim 2 , wherein the one or more speakers are an array of four or more speakers arranged around a volume within the helmet.

4. The system of claim 3 , wherein the array of four or more speakers and the vibration detector have a fixed positional relationship.

5. The system of claim 2 , wherein the one or more speakers are in headphones.

6. The system of claim 1 , wherein the vibration detector is part of an image sensor that includes a three-dimensional camera.

7. The system of claim 1 , wherein the vibration detector is a three-dimensional laser Doppler vibrometer.

8. The system of claim 1 , wherein the controller is configured to generate the sound as a synthetic ambient sound corresponding to the frequency of the vibration.

9. The system of claim 1 , wherein the controller is configured to generate the sound based on a mapping between the frequency of the vibration and the sound or based on machine learning.

10. attaching a vibration detector to an atmospheric pressure suit configured for a space environment, the vibration detector configured to detect a location of vibrations and identify a frequency of the vibrations; disposing a controller coupled to the vibration detector, the controller configured to generate a sound corresponding to the frequency of vibration detected by the vibration detector; one or more speakers disposed in the atmospheric pressure suit to receive the audio from the controller and to provide the audio as directional sound to a wearer of the atmospheric pressure suit; A method comprising:

11. The method of claim 10 , wherein the positioning of the one or more speakers is within a helmet of the atmospheric suit.

12. The method of claim 11 , wherein the arranging of the one or more speakers is as an array of four or more speakers arranged around a volume within the helmet.

13. The method of claim 12 , wherein positioning the array of four or more speakers includes establishing a fixed positional relationship with the vibration detector.

14. The method of claim 11 , wherein the placing of the one or more speakers is in headphones.

15. The method of claim 10 further comprising attaching an image sensor including the vibration detector and a three-dimensional camera.

16. The method of claim 10 , wherein said mounting said vibration detector is as a three-dimensional laser Doppler vibrometer.

17. The method of claim 10 , further comprising configuring the controller to generate the sound as a synthetic ambient sound corresponding to the frequency of the vibration.

18. The method of claim 10 , further comprising configuring the controller to generate the sound based on a mapping between the frequency of the vibration and the sound or based on machine learning.

Images