Online Mapping Soundscapes via Microphone Array Spatial Filtering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Online mapping applications lack the ability to provide an immersive experience by not incorporating soundscapes, which are essential for a true representation of a location, as they only offer visual images without auditory representations.
Innovation Solution
A system that uses a multi-element microphone array mounted on vehicles or other platforms to record and process sounds in real-time, filtering out unwanted noise and presenting a 360-degree auditory representation synchronized with the visual view, allowing users to experience the soundscape based on their direction and position.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If online mapping applications only provide visual images, then the system complexity is low, but the user experience lacks immersion and realism
Solution Approach 1:
The patent combines visual images and auditory soundscapes into a unified online mapping experience. The soundscape system merges audio recordings from multiple microphone elements with visual map data, creating a multi-sensory representation that enhances user immersion while maintaining system integration through synchronized playback of both visual and audio components.
Solution Approach 2:
The online mapping application is extended to serve multiple sensory functions simultaneously. The system not only provides visual navigation and location data but also delivers spatial audio representations of environments, making the mapping utility multi-functional by catering to both visual and auditory senses for a more comprehensive location representation.
2Measurement precision
If a multi-element microphone array is used to record soundscapes, then the auditory representation accuracy is improved, but the device complexity increases
Solution Approach 1:
The soundscape recording system is segmented into multiple independent microphone elements arranged in a spatial array. Each microphone captures audio from its specific position and direction, allowing the system to reconstruct three-dimensional spatial audio information. This segmentation enables precise auditory representation by capturing sound from multiple perspectives simultaneously.
Solution Approach 2:
The system transitions from traditional single-channel audio recording to multi-dimensional spatial audio capture. By arranging microphones in a three-dimensional array configuration, the system records sound not only in time but also in spatial dimensions (x, y, z coordinates), creating a volumetric representation of the acoustic environment that provides accurate directional and positional audio information.
3Reliability
If signal processing algorithms are applied to filter unwanted sounds, then the soundscape quality is improved, but the processing time and computational complexity increase
Solution Approach 1:
Signal processing algorithms are applied in real-time as audio data is being recorded from the microphone array. The system performs preliminary filtering and processing during the recording phase rather than as a post-processing step, separating desired soundscape information from unwanted noise (such as vehicle noise) concurrently with data acquisition. This approach minimizes processing delays and maintains soundscape quality without significant time loss.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables users to engage with a more immersive online mapping experience by providing a true auditory representation of locations, enhancing the realism and engagement of online mapping utilities like Google Street View by integrating spatially and temporally accurate soundscapes.
Implementation Method 1
a microphone array can be mounted on a Street View Vehicle to record sounds along the streets travelled for linking to an online map
Data Source
AI summary
Systems and methods are disclosed, which include or present “soundscapes” in or for online mapping utilities. To obtain the data for such soundscapes, along with cameras for visual images, a microphone array can be mounted on a vehicle to record sounds along the streets travelled for linking to an online map. A speech recognition algorithm is used to identify private conversations and remove them from the recording. The systems and methods for accomplishing this task include use of an array of microphones mounted in a special pattern with special materials on top of the vehicle to record sounds as the vehicle travels through space and time. A set of signal processing algorithms is also used to process the microphone signals autonomously in real-time, allowing the operator to immediately review them for quality assurance.