3D Sound Analysis System
The 3D sound analysis system addresses microphone non-linearity by using a population of 3D responsive modules and signal processing to achieve accurate detection and reconstruction of sound sources in three dimensions, enhancing signal fidelity and noise reduction.
Patent Information
- Application Number
- JP2024532192
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-12-03
- Filing Date
- 2022-12-05
- Publication Date
- 2024-11-27
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing microphones are substantially nonlinear in frequency response, sensitivity, and directivity, limiting their effectiveness in 3D sound applications, and there is a need for a microphone system that can achieve high linearity and directionality in three dimensions with selectable shapes and patterns.
A 3D sound analysis system comprising a population of 3D responsive microphone modules and a signal processor, which corrects non-linear characteristics to achieve linear performance through signal processing, allowing for the identification of multiple 3D sound sources, isolation of individual sounds with high fidelity, and reconstruction of sound waves at their sources.
The system enables accurate detection and reconstruction of sound sources in three dimensions with improved signal-to-noise ratio and high fidelity, suitable for professional and 3D applications.
Smart Images

Figure 2024544056000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to three-dimensional (3D) sound analysis systems, and more particularly to detecting sound waves in three dimensions and analyzing the output signals. [Background technology]
[0002] Microphones and systems for detecting sound are generally substantially non-linear in frequency response, sensitivity, and directionality.
[0003] Their directional options are also substantially limited.
[0004] Attempting to use such microphones for 3D sound applications exacerbates these problems.
[0005] It would be desirable to provide a microphone system that can detect sound with substantially high linearity in frequency response, sensitivity, and directionality, combined with any desired shape of directionality, such as spherical, hemispherical, conical, or any desired quantity and shape, or any combination or number thereof, that would be suitable for both professional microphone applications and 3D applications.
[0006] It is further desirable to provide a microphone system for identifying the 3D coordinates of many or all of the detected sound sources, a means for isolating the sound emissions of each sound source with good to high fidelity, and a means for reconstructing the sound sources at their source with good to high fidelity, generally including their lobe patterns. Summary of the Invention [Means for solving the problem]
[0007] As used herein, unless otherwise specified, the following terms and acronyms are used in this document: (i) The acronym "3D" refers to the term three dimensions. (ii) The term "sound source" refers to any 3D location that emits detectable sound. (iii) "Bidirectional microphone" or "figure 8 microphone" with reference to their polar pattern is a microphone type used in this document. (iv) The term "bidirectional vector" refers to the opposing directions, i.e., the direction leading to the true sound source and the direction leading to the false sound source, and is characteristic of all bidirectional microphones to any detectable sound source. (v) The terms “displacement,” “position,” and “vibration” are interchangeable with respect to the movement of sound-sensitive components in response to sound waves. (vi) The terms "tether" and "fiber" are interchangeable with respect to the anchoring of sound-sensitive components that respond to sound waves. (vii) The term “UV” refers to ultraviolet radiation. (viii) The term “epoxy” generally refers to a UV-curable epoxy, where the resin upon exposure to UV light typically fully cures within a few seconds. (ix) The term “LED” refers to a light-emitting diode. (x) The acronym "CMUT" stands for "Capacitive Micromachined Ultrasonic Transducer." (xi) The term "CMUT beam" refers to the emitted acoustic beam of a CMUT. (xii) The term “axis” refers to a coordinate axis. (xiii) The term "3D response microphone module" is interchangeable with the term "microphone module" or "bidirectional microphone" or "microphone". (xiv) The term "bidirectional vector information" is interchangeable with the term "bidirectional information." (xv) The term “RF” refers to radio frequency. (xvi) The term “FM” refers to frequency modulation.
[0008] The microphone modules according to the present disclosure are expected to be substantially matched in their characteristics of frequency response, sensitivity, and directivity. This match allows some non-linear aspects to be established as a reference by testing, after which these non-linear aspects can be corrected to linear characteristics for the microphone modules via signal processing. In this regard, the microphone modules can be considered as ideal or near-ideal 3D bidirectional microphone modules.
[0009] The present disclosure provides a 3D sound analysis system comprising a population of 3D response microphone modules and a signal processor that allows for the analysis of a detectable 3D sound environment. The system allows, for example, the following capabilities: a) identifying multiple 3D positions of multiple sound sources; b) isolating the individually received sounds from each source with good to high fidelity; c) signal correlation from each microphone module to improve the received signal-to-noise ratio; d) compensating the multiple received signals for high frequency roll-off for each distance to the sound source; e) reconstructing a plurality of emitted sound waves at each source with good to high fidelity, typically including some or all of the lobe patterns; and f) Selecting different sound sources or 3D regions or directions as output.
[0010] In one embodiment, the 3D response microphone modules are preferably configured in a 3D arrangement around either a central sensing position or a central sensing element to obtain bidirectional vector information regarding all impinging sound waves from a detectable sound source.
[0011] In one embodiment, a collection of microphone modules is arranged in a 3D configuration, typically as four microphone modules arranged as a tetrahedron, such that due to their different 3D positions, each microphone module acquires a slightly different set of 3D bidirectional vector information associated with each sound source.
[0012] In one embodiment, a distribution of microphone populations is used to collect source signal information from a large volume.
[0013] In one embodiment, the signal processor comprises: obtaining, from each of the microphone modules, a set of 3D bidirectional vector information thereof; and Converting the 3D vector information set into a digital information set; Calculating all 3D bidirectional vectors of every microphone module from the digital information set; Calculating the 3D intersection of a bidirectional vector common to all microphone modules, keeping in mind that only such common intersection represents the true 3D position of the sound source; Calculating the different distances from each microphone module to each sound source, thereby further calculating the arrival time difference from each sound source to each microphone module, thereby further calculating the time arrival synchronization of the collective received signals from each sound source, thereby maximizing the signal-to-noise ratio of the received sounds through such signal correlation; Calculating and compensating for high frequency sound roll-off from each sound source; and providing as an output a digital representation of the sound waves emanating from each sound source in the direction of the microphone cluster.
[0014] In one embodiment, each of the bidirectional microphones in the population of microphone modules are substantially matched in their characteristics, such as frequency response, sensitivity, and directionality, where such are established during manufacturing by testing as a standard and for quality control, thereby enabling the following from any bidirectional microphone: a) correcting non-linear characteristics (such as frequency response and sensitivity) to linear characteristics via a signal processor, thereby approaching the quality of an ideal or nearly ideal bidirectional microphone in terms of effective signal output; and b) Consistent and interpretable output.
[0015] Any given microphone module may provide sufficient 3D sound information that the signal processor, in conjunction with determining the sound received from each detectable sound source, may determine a bidirectional vector in space pointing to the multiple detectable sound sources. The resulting ensemble of microphone modules in combination with further signal processing may identify the 3D location of each detectable sound source via the intersection of the bidirectional vectors from each microphone module.
[0016] In one embodiment, the bidirectional microphones of any given microphone module are arranged in a 3D arrangement, with at least three bidirectional microphones aligned on the x, y and z axes. The 3D arrangement may comprise four bidirectional microphones arranged in a tetrahedron, or any other number of bidirectional microphones arranged in a suitable polygonal arrangement.
[0017] In one embodiment, a collection of microphone modules are arranged in a 3D arrangement, preferably four microphone modules arranged in a tetrahedron, noting that five or more microphone modules tend to provide improved 3D signal information.
[0018] In a first aspect, a plurality of high frequency sound waves are provided in the form of substantially narrow beams, consisting of continuous waves or pulses, between a plurality of transmitter and receiver pairs acting in the volume of a bidirectional microphone.
[0019] Sound waves arriving to the side of the axis of the narrow beam modulate the path length of the beam so that a continuous beam is received as frequency modulation (FM) and pulses are preferably received at the receiver as pulse position modulation (PPM) via zero-crossing detection.
[0020] Multiple transmitter and receiver pairs are generally closely spaced and preferably positioned such that the narrow beams intersect at their midpoints in the xyz axis arrangement.
[0021] The multiple narrow beams are preferably at substantially high frequencies to provide both substantially narrow beams of impinging acoustic waves and substantially high resolution.
[0022] In a preferred form, Capacitive Micromachined Ultrasonic Transducers (CMUT) are used as multiple transmitter and receiver pairs operating with pulsed acoustic waves in the preferred frequency range of 10 MHz to 40 MHz.
[0023] Other forms of transmitter and receiver pairs can be used, generally with a continuous beam. Examples include ceramic, crystal and electret transducers, as well as fiber optic microphone receivers.
[0024] In a second embodiment, an actively centered levitated bubble is used as the element that responds to incoming acoustic waves; a) the levitated bubble can move in any direction with equal ease, thereby acting as an omnidirectional element; b) the floated bubbles may have various combinations of bubble compositions or structures; c) multiple centering devices may be used to actively center the levitated bubble; d) Multiple sensing devices can be used to sense the position of the levitated bubbles.
[0025] The bubble that was floated a) substantially thin to minimize mass and maximize sensitivity; b) small in diameter compared to the wavelength of the highest frequency of the incoming sound waves; c) having porosity to maintain its diameter with changing atmospheric conditions, which porosity can be incorporated by means of inherent porosity in the polymer or epoxy film, evaporated particles incorporated in the polymer or epoxy film, bombardment by heavy ions, etc.; d) Any floated bubbles available are quality controlled during manufacturing to ensure that they meet substantially rigorous standards, thereby ensuring conformance in manufacturing.
[0026] In one embodiment, active centering of the levitated bubble is accomplished using multiple centering devices that generate a magnetic field. The levitated bubble, preferably made of a polymer or epoxy material, may contain iron nanoparticles or other magnetically responsive materials. Active centering may be enabled using multiple centering devices, preferably four electromagnets in a tetrahedral arrangement.
[0027] In another embodiment, the levitated bubble can be actively centered using multiple centering devices that generate an electrostatic charge. The levitated bubble, preferably made of a polymer or epoxy material, can have an electrostatic charge. Active centering can be enabled using multiple centering devices, preferably four electrostatic plates in a tetrahedral arrangement.
[0028] In a further embodiment, the levitated bubble is actively centered via high frequency acoustic waves so that it is within a permanent zero, within the web of the grazing beam, or nudged into place via the grazing beam.
[0029] The position of the levitated bubble is preferably sensed using multiple sensing devices based on laser interferometry or by forming a capacitor with a set of three plates in the xyz axes as three RF oscillators in a manner similar to a radio frequency (RF) condenser microphone. In addition, multiple sensing devices may use any other suitable sensing method such as RF reflection or acoustic beam reflection.
[0030] In a third embodiment, a plurality of tethered bubbles, their tethers, or a combination of tethered bubbles and tethers are used as elements that react to incoming acoustic waves; a) preferably three elements are used with each element reacting to incoming sound waves; b) preferably the three elements are tethered bubbles; c) the tether of each tethered bubble is preferably axial, either through the bubble or by joining the tether ends to the bubble; d) each tethered bubble tether is substantially thin and elongated; e) the tether of each tethered bubble is made of an elastomeric polymer or fiber; f) each tethered bubble is centered on its tether; g) the tethered bubble can move laterally to the tether; h) Multiple tethered bubbles can be formed from various combinations of bubble compositions or structures.
[0031] In one embodiment, the tethered bubble is a) substantially thin to minimize mass and therefore maximize sensitivity; b) preferably small in diameter compared to the wavelength of the highest frequency of interest of the incoming acoustic waves; c) possessing porosity, thereby maintaining its diameter with changing atmospheric conditions, which porosity can be incorporated by means of inherent porosity in the polymer or epoxy film, evaporated particles incorporated in the polymer or epoxy film, bombardment by heavy ions, etc. d) The bubbles accepted for use are quality controlled during manufacturing to ensure that they meet substantially rigorous standards, thereby ensuring conformance in manufacturing.
[0032] In one embodiment, the multiple sensing devices are based on laser interferometry or by forming a capacitor with three plates in the xyz axis as three RF oscillators in a manner similar to an RF condenser microphone. Additionally, the multiple sensing devices may use any other suitable sensing method such as RF reflection or acoustic beam reflection.
[0033] It will be appreciated that there are many common existing techniques that could be applied in the manner discussed herein, such as using coils instead of straight tethers, replacing tethers with aerogel or webbing, using polyhedral cages to support microphone modules, dust shielding, wired or wireless operation, laser scanning of the environment to aid or accompany sound source localization data, etc.
[0034] It will be appreciated that there are many potential applications for microphone systems, such as isolating individual voices in a crowd or choir, isolating instruments in an orchestra, isolating speakers in noisy environments, wildlife monitoring, security, aircraft flight recorders, industrial monitoring, noise and vibration discrimination for manufacturing or defect detection, and media production.
[0035] For purposes of clarity, all figures are shown without or with a minimum of mounting structures and coverings, and further, are shown without electronics, cables, etc. as these are common in the art; any suitable types may be used and it is assumed that such will be utilized in all complete designs.
[0036] A preferred general embodiment will now be described, by way of example only, with reference to the accompanying drawings, in which: [Brief description of the drawings]
[0037] [Figure 1] FIG. 1 is a diagram of a 3D sound analysis system comprising a collection of microphone modules in a 3D arrangement, where each microphone module has a 3D response, where each microphone module comprises a 3D arrangement of bidirectional microphones, and a signal output from the system is processed by a signal processor programmed to provide a processed signal output. [Diagram 2] FIG. 1 is a perspective view with a cubic reference frame of the microphone module showing the general principle of operation, in which at least three bidirectional microphones of any suitable type, such as high frequency sound transducers, are preferably oriented in XYZ coordinates and more preferably sense sound waves impinging and passing through a central point; this system forms the first main aspect of the microphone module. [Diagram 3] FIG. 3 shows a variation of the microphone module of FIG. 2 showing four bidirectional microphones in a different spatial arrangement, illustrating that more than two bidirectional microphones may be used, and in any suitable spatial arrangement according to the present disclosure. [Figure 4] FIG. 4 is a perspective view with a cubic reference frame of the second main embodiment of the microphone module including a levitated bubble that acts as a 3D displacement sensitive device to impinging sounds from any 3D direction. The levitated bubble means may include any suitable means such as magnetic, electrostatic, ultrasonic, ion beam, etc. The bubble displacement sensor means may include any suitable means such as laser interferometry, ultrasonic, RF capacitive resonant circuit, etc. FIG. 4 shows a bubble levitation means comprising four centering devices arranged in a tetrahedron, such as electromagnets acting on a magnetically sensitive bubble. [Diagram 5]FIG. 5 is a perspective view with a cubic reference frame of the second main embodiment of the microphone module including a levitated bubble that acts as a 3D displacement sensitive device to impinging sounds from any 3D direction. The levitated bubble means may include any suitable means such as magnetic, electrostatic, ultrasonic, ion beam, etc. The bubble displacement sensor means may include any suitable means such as laser interferometry, ultrasonic, RF capacitive resonant circuit, etc. FIG. 5 shows the system of FIG. 4 with the addition of four displacement sensitive devices arranged in a tetrahedron, such as laser interferometers reflecting off the levitated bubble. [Figure 6] FIG. 6 is a perspective view with a cubic reference frame of the second main embodiment of the microphone module including a levitated bubble that acts as a 3D displacement sensitive device to impinging sounds from any 3D direction. The levitated bubble means may include any suitable means such as magnetic, electrostatic, ultrasonic, ion beam, etc. The bubble displacement sensor means may include any suitable means such as laser interferometry, ultrasonic, RF capacitive resonant circuit, etc. FIG. 6 shows the system of FIG. 4 with the addition of three displacement sensitive devices arranged in the xyz axes, such as laser interferometers reflecting off the levitated bubble. [Figure 7] FIG. 7 is a perspective view with a cubic reference frame of the second main embodiment of the microphone module including a levitated bubble that acts as a 3D displacement sensitive device to impinging sounds from any 3D direction. The levitated bubble means may include any suitable means such as magnetic, electrostatic, ultrasonic, ion beam, etc. The bubble displacement sensor means may include any suitable means such as laser interferometry, ultrasonic, RF capacitive resonant circuit, etc. FIG. 7 shows the system of FIG. 4 with the addition of three displacement sensitive devices arranged in the xyz axes, such as an RF capacitive resonant circuit in conjunction with a conductive levitated bubble. [Figure 8]FIG. 13 is a perspective view with a cubic reference frame of a third embodiment of a microphone module according to the present disclosure, in which three fibers or bubbles, preferably tethered in the middle with an elastic fiber, are oriented in XYZ coordinates and function as a lateral displacement sensitive device to impact sounds as an active component of a bidirectional microphone, in particular using any suitable displacement sensor method of the bubbles or fibers such as laser interferometry, RF tuning circuits, ultrasound, stretching of the fibers with a laser or tension, or if the fibers are conductive with an RF tuning circuit, or by any other suitable sensing means, in which further fibers used by themselves may include alternative attached objects to improve sensitivity, in which other suitable number or orientation means of bubbles or fibers or with a bidirectional microphone may be used. [Figure 9] According to a further form of the invention, a variation of FIG. 8 is shown in which only two tethered bubbles are used as components of at least three bidirectional microphones oriented in XYZ coordinates. [Figure 10] FIG. 1 is a perspective view of an example of a Platonic solid that may be adapted as, but is not limited to, a framework shape or spatial arrangement of microphone modules or a grouping arrangement of microphone modules in accordance with all forms of the present invention. [Figure 11] 1 shows a basic means for forming a bubble suitable for any bubble application of the present invention, comprising an epoxy compound for forming the bubble, a bubble forming means, and a UV curing system for the bubble. [Figure 12] A perspective view of a manufacturable microphone module utilizing a magnetically levitated bubble is shown, comprising a structural cage, a bubble protection cage, a bubble incorporating a magnetically responsive material, an electromagnet for bubble positioning, an infrared LED reflectometer for initial bubble centering measurement, and a laser interferometer for sensing bubble deflection from an impinging acoustic wave. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0038] For clarity, the sound source is not shown in the drawing but is assumed to be present.
[0039] Referring to diagram 1 and perspective view 2, a 3D sound analysis system 1 according to a general embodiment of the present disclosure is shown comprising a collection of microphone modules 2 and a signal processor 3 which together provide excellent 3D analysis and modelling of sound sources and their selected signal output shapes.
[0040] In this embodiment the microphone module cluster 2 consists of four or more microphone modules 4 arranged in any suitable 3D arrangement, whose signal outputs 6 are then received by a signal processor 3 to produce a processed signal output 9.
[0041] The 3D positions and orientations of all microphone modules 4 relative to the 3D reference point must be input to the signal processor 3 to allow meaningful data processing and output.
[0042] A microphone module 4 as shown in FIG. 2 having a general support framework 10 comprises at least three bidirectional microphones 11 oriented in XYZ coordinates to thereby obtain a set of bidirectional information about sounds arriving from all detectable sound sources in three dimensions, preferably from a common central position; the set of bidirectional information is then processed as a first signal processing step by a signal processor 3, first to convert the received information into digital information and then to resolve this information into a 3D computer simulation of bidirectional vectors pointing to the detectable sound sources and to isolate the sounds received from these directions.
[0043] The bidirectional information from the population 2 of microphone modules in Figure 1 can be typically signal processed as a second signal processing step by a signal processor 3 to determine the intersection points of bidirectional vectors pointing to the detectable sound sources and thereby determine the true 3D positions of all detectable sound sources and their refined received sound signals.
[0044] Since the distance to all true 3D sound sources is unknown, and therefore the arrival time and relative amplitude of the sound signal can be calculated, refinement of the received sound signal is possible, compensation can then be made for high frequency roll-off, and through signal correlation, errors and noise can be minimized.
[0045] Further signal processing can then yield the signal emanating from the source and other desired information such as the approximate lobe pattern, its selected power and signal manipulation, apparent sound sources that are actually reflections from hard surfaces, etc.
[0046] The outline of a sample processor program 8 for the signal processor 3 may do the following: a) determining the bidirectional direction from each microphone module 4 to all sound sources; b) determining the 3D positions of all sound sources via the corresponding intersection points of all bidirectional orientations in the microphone module population 2; c) determining the distance from each sound source to each microphone module 4, thereby compensating for high frequency roll-off; d) determining the actual and maximum magnitude of the lobe pattern for each sound source; e) selecting signals from a desired number of sources as outputs; f) applying desired signal conditioning such as selected bandwidth, quality control, and position of any virtual microphones; g) applying signal mixing as desired; h) outputting the desired signal information as a processed signal output 9;
[0047] 2 in conjunction with a further view of FIG. 2 as perspective view 3, one can see that one example of four bidirectional microphones 11 have their sensing intersecting at a center point using a different 3D positioning arrangement. Obviously, many other arrangements such as a tetrahedron or more bidirectional microphones 11 can be used, but increasing the number of bidirectional microphones 11 in a single microphone module 4 generally adds little extra signal information compared to increasing the number of microphone modules 4 that comprise the cluster 2 of microphone modules.
[0048] With further reference to FIG. 2, shown is the first of three main embodiments of a 3D bidirectional microphone system, in which three bidirectional microphones 11 are in the form of an ultrasound beam transducer, each comprising a transmitter 12, a receiver 13, and an ultrasound beam 14. Since both a small sampling volume and a sampling frequency much higher than the highest sound frequency of interest are desirable for good quality sound recording, one preferred form of ultrasound beam transducer is a capacitive micromachined ultrasound transducer (CMUT), preferably operating at 10 MHz to 40 MHz. These devices operate via the transmission and reception of acoustic pulses, where a substantially high frequency pulse repetition rate produces a substantially narrow beam of acoustic pulses, whereby interfering lateral acoustic waves causes a deflection of the narrow beam, modulating the path length and therefore the arrival time of the pulse, thereby causing pulse position modulation as the output signal.
[0049] An alternative type of transducer is a continuous wave transducer, such as a ceramic ultrasonic transducer, in which an impinging sound wave induces FM modulation in the output signal.
[0050] The advantage of these systems is their simplicity combined with a substantially wide frequency and dynamic range.
[0051] Referring to perspective Figures 4 to 7, shown is the second of the three main embodiments of a 3D bidirectional microphone system according to the present invention, in which the levitated bubble 15 is actively centered by a centering device 16, and in which the levitated bubble 15 acts as a displacement sensitive device to impact sounds from any 3D direction, and in which the displacement of the levitated bubble 15 is detected by a sensing device based on any suitable type of sensor, such as a laser interferometer or ultrasound in the scheme of Figure 6, or an RF capacitive resonant circuit in the scheme of Figure 7, whereby the levitated bubble 15 and its sensing device form a bidirectional microphone 11.
[0052] The preferred number and orientation of bidirectional microphones 11 is in the same manner as in FIG. 2, but may be more numerous or have a different orientation.
[0053] A preferred number and orientation of centering devices 16 is four and arranged in a tetrahedron, but there may be more and they may have different orientations.
[0054] The levitated bubble 15 is preferably substantially thin and light to maximize its sensitivity to acoustic waves.
[0055] The levitated bubble 15 is preferably composed of a material such as a polymer or epoxy with optional additives added thereto such as iron nanoparticles, reflective additives, conductive additives, evaporative particles, etc.
[0056] The levitated bubble 15 is preferably porous to air so as to be unaffected by changing air pressure, where such porosity may be inherent in its construction material or may be formed via doping the forming material with evaporated particles or impinging particulates on the bubble.
[0057] The levitated bubbles 15 within the fabrication will be selected for substantial high conformance according to criteria to ensure operationally consistent response.
[0058] The centering device 16 may be based on any suitable method, such as magnetic, electrostatic, ultrasonic, ion beam, etc., where for magnetic systems the bubbles are doped with magnetically susceptible materials such as iron nanoparticles, where for electrostatic systems the bubbles may be electrostatically innately responsive or may carry an electric charge.
[0059] Preferably, the centering device 16 is based in turn on methods such as firstly magnetic, secondly electrostatic, thirdly via ultrasound, and fourthly by any other suitable method such as micromechanically, where common devices according to the art locally generate a magnetic field, an electric field, or an ultrasound beam, or perform a mechanical action, etc.
[0060] FIG. 4 shows the centering device 16 .
[0061] FIG. 5 shows FIG. 4 together with a tetrahedral bidirectional microphone 11 means.
[0062] FIG. 6 shows a laser, ultrasonic or other suitable bidirectional microphone 11 means according to the art.
[0063] FIG. 7 shows an RF capacitive resonant circuit bidirectional microphone 11 means according to the art, where the levitated bubble 15 is conductive, and preferably each bidirectional microphone 11 utilizes two conductive plates 17 in conjunction with any capacitive sensitive means 18, such as part of an RF tuned circuit.
[0064] Referring to perspective Figures 8 and 9, shown is the third of three main embodiments of a 3D bidirectional microphone system in which each bidirectional microphone 11 means is tethered in place by an elastic fiber 20 or by an elastic fiber 20 alone, thereby allowing lateral movement 21 of the tethered bubble 19 or elastic fiber 20 in response to an impinging acoustic wave, in combination with any suitable accompanying sensing means for providing a signal output of the lateral displacement of the bubble or fiber, including the tethered bubble 19, or elastic fiber stretching is used, for example laser interferometer, RF circuitry, ultrasound, electrical resistance, or tension, or other suitable means are used.
[0065] The elastic fibers 20 used by themselves may include alternative attached objects to improve sensitivity.
[0066] Other numbers of tethered bubbles 19, elastic fibers 20 and bidirectional microphone 11 means may be used in any suitable combination and orientation.
[0067] The lateral bubble or fiber deflection sensing means, not shown, would be in the plane of an indicator circle that is perpendicular to the orientation of the elastic fiber 20 indicating lateral movement 21.
[0068] FIG. 8 shows three tethered bubbles 19 on three elastic fibers 20, each set of which can be used to form a bidirectional microphone 11, while FIG. 9 shows a variation in which two tethered bubbles 19 are attached to two elastic fibers 20, one set of which can be used to form two bidirectional microphones 11, while the other set forms one bidirectional microphone 11.
[0069] The tethered bubble 19 may be attached to an elastic fiber 20 by being threaded through the elastic fiber 20 or by having two shorter elastic fibers 20 joined at opposite ends.
[0070] It will be appreciated that other numbers of tethered bubbles 19, elastic fibers 20, and bidirectional microphone 11 means may be used in any suitable orientation.
[0071] Referring to perspective FIG. 10, shown is a perspective view of an example Platonic solid 22 that may be adapted as, but is not limited to, a framework shape or spatial arrangement of a microphone module 4 or a cluster arrangement of microphone modules 4, where such a shape may have manufacturing or positioning advantages such as strength, orientation and position matching, in accordance with all aspects of the present disclosure.
[0072] Referring to perspective FIG. 11, shown is a basic means 30 for forming a bubble 31 suitable for any bubble application of the present disclosure, where the basic means 30 comprises a vertically downwardly oriented air-filled syringe 32 incorporating a square-ended needle tip, on which is placed a blob 33 of UV-curable epoxy compound incorporating a magnetically responsive material that will solidify in a few seconds when exposed to UV light, whereupon the plunger of the syringe 32 can be quickly depressed to form an epoxy bubble 31 that will move vertically downward in the direction of arrow 34 away from the syringe, whereupon the bubble 31 will enter a small hole 35 in a UV LED lined box 36 shown in cutaway view 37, whereupon the UV LED, not shown for clarity, will then emit UV light according to arrow 38 to activate the epoxy bubble 31 for tens of seconds to fully cure before it reaches the bottom of the box 36, whereupon the bubble 31 will then be ready for use in a microphone module.
[0073] The incorporation of magnetically responsive materials is particularly suitable for magnetically levitated bubble systems and is not required for electrostatically levitated bubble systems.
[0074] A suitable magnetically responsive material is magnetite, either in the form of nanoparticles, particles or compounds.
[0075] Iodine in the form of nanoparticles, particles or compounds incorporated into the epoxy prior to curing will provide air pressure equalization without damage to the bubble 43 and will provide fine porosity in the bubble 43 walls after the iodine sublimes.
[0076] Referring to perspective view 12, shown is a manufacturable microphone module 4 comprising a structural cage 41, a bubble protection cage 42, a bubble 43 incorporating a magnetically responsive material, an infrared LED reflectometer module 44 for initial bubble centering measurement, an electromagnet 45 for bubble positioning, and a laser interferometer 46 with a laser beam 47 for sensing bubble 43 deflection from an impinging sound wave.
[0077] The preferred material is fiberglass circuit board since the structural cage 41 needs to be rigid and such a design will also allow for integrated writing to the various components.
[0078] The bubble protection cage 42 in the form of a spherical plastic mesh is easily moldable and protects the bubble from both external and internal impacts.
[0079] A bubble 43 incorporating the magnetically responsive material may be constructed as illustrated by bubble 31 in FIG.
[0080] Four infrared LED reflectometer modules 44 for initial bubble 43 centering measurement are arranged in a tetrahedron so that when the bubble 43 is centered the signal reading is the same and when the bubble 43 is not centered the signal reading is proportionally different which can be used in conjunction with a signal processor such as signal processor 3 to determine the direction in which the bubble 43 needs to be moved by the electromagnet 45. The action of the system is mainly for initial power up when the bubble 43 will rest against the bubble protection cage 42. If the bubble 43 is forced out of position by mechanical shock or wind gust etc. the system will also start to work.
[0081] It will be appreciated that the functionality of the infrared LED reflectometer module 44 may be replaced by a radio frequency or sonic reflectometer system.
[0082] Positioning of the bubble 43 is achieved by four electromagnets 45 arranged in a tetrahedron, whereby the bubble 43 can be moved in any 3D direction by varying the magnetic field strength of each electromagnet 45, whereby such corrections are provided by a signal processor, such as signal processor 3 using data from either an infrared LED reflectometer module 44 or a laser interferometer 46.
[0083] Three laser interferometers 46 with laser beams 47 for sensing the bubble 43 deflection from the impinging acoustic wave are mounted along xyz axes that intersect at the central location of the bubble 43, where these bubble 43 deflection measurements are extremely accurate.
[0084] When the bubble 43 is centered, the laser interferometer 46 performs two functions via a signal processor such as signal processor 3: first, to provide incremental positioning correction of the bubble 43 to counter the displacement motion caused by gravity, and second, to detect all displacements in 3D caused by the impinging acoustic waves, whereupon a digital representation of the bidirectional vectors to each sound source is generated.
[0085] If only an omnidirectional microphone response to the impinging sound waves at the bubble 43 is required, the signal output can be used as is. If isolation of each sound source in the selected 3D space is required, a cluster of microphone modules 4 is needed as discussed in Fig. 1. For large volumes of spaces, such as an orchestra or a stadium, multiple distributed sets of clusters of microphone modules 4 are needed.
[0086] Although not depicted for clarity, it is understood in the art that the microphone module 4 will also have some form of dust protection and would typically be mounted in a housing such as those used for handheld microphones.
[0087] Reference herein to any prior publication (or information derived therefrom) or to any known matter is not, and should not be construed as, an acknowledgement or admission or any form of suggestion that the prior publication (or information derived therefrom) or known matter forms part of the common general knowledge in the field of endeavor to which this specification pertains.
[0088] Additionally, the foregoing merely describes several embodiments, and alterations, modifications, additions and / or variations may be made thereto without departing from the scope and spirit of the disclosed embodiments, which embodiments are illustrative and not limiting.
[0089] Further, the disclosure has been described in connection with what are presently considered to be the most practical and preferred embodiments, and it is to be understood that the disclosure is not limited to the disclosed embodiments, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the disclosure.
[0090] Also, the various embodiments described above may be implemented in conjunction with other embodiments, for example aspects of one embodiment may be combined with aspects of another embodiment to achieve yet another embodiment.
[0091] In the claims that follow, and in the preceding description, unless the context dictates otherwise by clear language or necessary implication, the word "comprises" and variations thereof, such as "comprises" or "comprised," are used in an inclusive sense, i.e., to specify the presence of stated features, but not to preclude the presence or addition of further features in various embodiments of the apparatus and methods as disclosed herein.
[0092] In the preceding description of the preferred embodiment, certain technical terms have been reclassified for the purpose of clarity. However, it is to be understood that the disclosure is not intended to be limited to the specific terms so selected, and each specific term includes all technical equivalents that operate in a similar manner to achieve a similar technical purpose. Terms such as "position" and "positioning", "framework" and "acoustic", "sound", and "high fidelity" are used as convenient terms to provide a point of reference and should not be construed as limiting terms.
Claims
1. a population of microphone modules arranged in a 3D arrangement, each microphone module configured to acquire a set of bidirectional information; Signal processor and A sound analysis system comprising: The signal processor, obtaining from each of said microphone modules a set of 3D bidirectional vector information thereof; converting the 3D bidirectional vector information set into a digital information set; Calculating all the 3D bidirectional vectors of every microphone module from the digital information set; Calculate the 3D intersection of said bidirectional vectors common to all microphone modules, keeping in mind that only such common intersection represents the true 3D position of the sound source; Calculating the different distances from each microphone module to each sound source, thereby further calculating the arrival time difference from each sound source to each microphone module, thereby further calculating the time arrival synchronization of the collective received signals from each sound source, thereby maximizing the signal-to-noise ratio of the received sounds through such signal correlation; Calculate and correct for high frequency sound roll-off from each sound source; Provides as output a digital representation of the sound waves emanating from each sound source in the direction of the microphone cluster The system is programmed to do so.
2. The system of claim 1 , wherein each microphone module comprises at least three bidirectional microphones.
3. The system of claim 2 , wherein the at least three bidirectional microphones are oriented at equal angles to each other along each xyz axis or tetrahedron.
4. The system of claim 2 or 3, wherein the at least three bidirectional microphones are configured to acquire the set of bidirectional information from a common 3D position or a common sound-sensitive element or multiple sound-sensitive elements near each other.
5. 5. The system of claim 2, wherein each of the bidirectional microphones is substantially matched in frequency response, sensitivity, and directionality.
6. 6. The system of claim 2, wherein the signal processor is further programmed to convert the set of bidirectional information obtained from each microphone module into a set of digital information by comparing the signal strength and orientation of each microphone in conjunction with determining the received sound from each detectable sound source to derive a solution set of multiple bidirectional vectors in space pointing to multiple detectable sound sources.
7. The signal processor further comprises: determining a plurality of intersection points of the plurality of bidirectional vectors; and determining a 3D position of each detectable sound source from the plurality of detectable sound sources; The system of claim 6, programmed to:
8. 8. A system according to claim 4 or any one of claims 5 to 7 when dependent on claim 4, wherein the at least three bidirectional microphones are arranged around a target volume.
9. A system as described in claim 4 or any one of claims 5 to 7 when dependent on claim 4, wherein the at least three bidirectional microphones are arranged around a levitated or tethered bubble.
10. 9. The system of claim 8, wherein the at least three bidirectional microphones are each configured as an xyz oriented pair of transmitter and receiver.
11. The system of claim 10, wherein the xyz oriented transmitter and receiver pair is a capacitive micromachined ultrasonic transducer pair or a ceramic resonator pair.
12. 11. The system of claim 10, wherein the xyz oriented transmitter and receiver pairs are configured with transmission frequencies generally within the range of 100 kHz to 40 MHz.
13. The system of claim 9 , configured to actively center the levitated bubble using a magnetic or electric field.
14. The system of claim 13 , wherein the levitated bubbles are deflected by impinging acoustic waves from a plurality of external acoustic sources.
15. 15. The system of claim 13 or 14, wherein the levitated bubbles incorporate magnetically influenced particles, nanoparticles or compounds.
16. A system according to claim 14 or 15, wherein the position of the levitated bubble is measured by a plurality of xyz oriented sensors.
17. 17. The system of claim 16, wherein the multiple x-y-z oriented sensors are either multiple laser interferometry systems, multiple radio frequency oscillator systems, multiple radio frequency reflection systems, multiple optical reflection systems, or multiple acoustic beam reflection systems.
18. 10. The system of claim 9, wherein the tethered bubbles include at least three sets of bubbles each held by at least one elastic fiber respectively oriented in x-y-z directions, each set of bubbles supported at a midpoint of the at least one fiber and adapted to move laterally relative to its suspension axis in response to an impinging acoustic wave.
19. 20. The system of claim 18, wherein the at least three sets of bubbles include a first bubble axially penetrated by a fiber, a second bubble axially joined to an end point of a pair of fibers, and a third bubble having at least three axial fibers surrounding it in a tetrahedral cage.
20. 20. The system of claim 19, wherein the fiber is used to detect sound.
21. 21. The system of any one of claims 18 to 20, wherein the fiber is made from a fiber coil, a fiber spring, a webbing, a foam, or an aerogel.
