Wearable Virtual Microphone Synthesis for Position-Aware Audio
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable devices lack the capability to accurately record and synthesize audio signals from virtual microphones, particularly in augmented reality environments, leading to suboptimal user experiences.
Innovation Solution
A wearable device equipped with a camera, communication circuitry, and a processor that combines a virtual microphone with external objects, allowing it to obtain audio signals from both internal and external devices, and synthesize these signals based on positional data to create a coherent audio experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a wearable device uses only its built-in microphone to record audio, then the device structure remains simple, but the audio recording accuracy and immersion are insufficient when the device is not physically present at the sound source location
Solution Approach 1:
The patent creates a virtual microphone that copies the acoustic characteristics of a physical microphone located at a different position. The system transmits audio signals from external devices to the wearable device, where they are processed to simulate the sound as if captured by a microphone at the desired location, without requiring actual physical presence
Solution Approach 2:
The patent introduces an intermediary system consisting of external electronic devices (such as smartphones or servers) that capture audio signals and transmit them to the wearable device. This intermediary approach allows the wearable device to access audio from locations where it is not physically present, resolving the contradiction between simple structure and accurate remote audio recording
2Adaptability or versatility
If the wearable device synthesizes audio signals from multiple sources, then the audio immersion is enhanced, but the processing complexity and computational requirements increase
Solution Approach 1:
The patent divides the audio synthesis task into separate segments: external devices capture and pre-process audio signals, while the wearable device performs final synthesis and rendering. This segmentation allows complex processing to be distributed, reducing the computational burden on the wearable device while maintaining high audio synthesis capability
Solution Approach 2:
The patent implements preliminary action by having external devices capture and prepare audio signals before transmission to the wearable device. Audio signals are pre-processed and positioned according to spatial information in advance, so that the wearable device only needs to perform final synthesis, reducing real-time processing complexity
3Reliability
If the wearable device uses external electronic devices to transmit audio signals, then the audio signal quality and positional accuracy are improved, but the dependency on external devices increases
Solution Approach 1:
The patent implements multi-functionality by designing the wearable device to operate in multiple modes: it can use external devices when available for high-quality audio, and switch to its built-in microphone when external devices are unavailable. This universal approach maintains device independence while enabling high-quality audio recording when conditions permit
Data Source
AI summary
A wearable device includes: a camera; communication circuitry; a microphone; and a processor configured to: receive an input for combining a virtual microphone to an external object adjacent to the wearable device; broadcast a signal including information to track the external object combined with the virtual microphone by the input; obtain, based on a position of the external object identified based on frames obtained from the camera, a first audio signal from the microphone; obtain at least one second audio signal from at least one external electronic device through the communication circuitry, wherein the at least one second audio signal is transmitted from the at least one external electronic device as a response to the signal; and obtain, by synthesizing the first audio signal and the at least one second audio signal based on the position of the external object, a third audio signal with respect to the virtual microphone.