Ribbon Display Audio Conferencing Visualizing Sound Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current audio conferencing systems lack an efficient method to visually display and interact with audio information, particularly in inexpensive devices, which limits the ability to differentiate between multiple speakers and manage noise levels effectively.
Innovation Solution
The implementation of a soundfield-capturing endpoint with a microphone array and auditory scene analysis (ASA) that processes and displays audio data on a ribbon display, allowing users to interact with and manipulate the visual representation of sound objects, enhancing the perception of spatial audio and noise management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a visual display and user interface are added to audio conferencing devices, then the ability to visually represent sound sources and manage noise is improved, but the device complexity and cost increase
Solution Approach 1:
The display is segmented into multiple independent visual indicators, each representing different audio parameters (sound source locations, noise levels, speaker activity). This allows the system to present comprehensive audio information through simple, modular visual elements rather than a complex continuous display
Solution Approach 2:
A processor acts as an intermediary between the audio input signals and the visual display, analyzing audio data and converting it into simplified visual representations. This intermediary layer handles the complexity of audio processing while presenting simple visual information to the user
2Measurement precision
If auditory scene analysis and spatial processing are implemented, then the ability to differentiate between multiple speakers is improved, but the processing requirements and device cost increase
Solution Approach 1:
Complex mechanical audio processing and spatial analysis is replaced with digital signal processing algorithms. The system uses software-based auditory scene analysis to achieve precise speaker differentiation without requiring complex hardware processing mechanisms
Solution Approach 2:
The system creates visual copies or representations of audio sources rather than directly processing and displaying raw audio signals. This allows multiple speakers to be differentiated and represented visually without requiring the system to simultaneously process all audio signals at full complexity
3Loss of information
If a ribbon display is used to show sound field information, then the visual representation of spatial audio is improved, but the ease of manufacture decreases
Solution Approach 1:
The ribbon display is divided into multiple independently controllable segments or zones, each representing different spatial audio information. This segmentation allows the display to show complex spatial audio data while using simple, easily manufactured individual display elements that can be produced using standard techniques
Data Source
AI summary
A method in a soundfield-capturing endpoint and the capturing endpoint that comprises a microphone array capturing soundfield, and an input processor pre-processing and performing auditory scene analysis to detect local sound objects and positions, de-clutter the sound objects, and integrate with auxiliary audio signals to form a de-cluttered local auditory scene that has a measure of plausibility and perceptual continuity. The input processor also codes the resulting de-cluttered auditory scene to form coded scene data comprising mono audio and additional scene data to send to others. The endpoint includes an output processor generating signals for a display unit that displays a summary of the de-cluttered local auditory scene and/or a summary of activity in the communication system from received data, the display including a shaped ribbon display element that has an extent with locations on the extent representing locations and other properties of different sound objects.