Display Control System for Spatial Sound Source Visualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional display systems for head-mounted displays and smart devices struggle to visually represent sound fields, including sounds outside a user's field of vision, making it difficult for users to intuitively understand the source of sounds.
Innovation Solution
A display control system comprising a recognizer, a calculator, and a display controller that recognizes sound sources, calculates their direction relative to the user, and outputs display information in formats determined by the angle between the user's facing direction and the sound source direction, allowing for visual representation of sounds across the user's field of view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional display techniques are used to show text information, then the display is simple and straightforward, but the sound field including sounds outside the user's field of vision cannot be visually expressed
Solution Approach 1:
The patent extends the display from a two-dimensional screen to a three-dimensional spatial representation by projecting sound source positions and sound field information into the user's field of view. Text information is displayed at positions corresponding to the spatial location of sound sources, creating a spatial audio-visual mapping that preserves directional and positional information while maintaining readability.
Solution Approach 2:
The patent introduces text information as an intermediary element that bridges the gap between auditory input and visual perception. By displaying text labels at the spatial positions of sound sources, the system mediates the connection between the user's hearing and vision, allowing sounds outside the direct field of vision to be identified and localized through visual text cues.
2Loss of information
If the display shows text information at sound source positions, then spatial sound field information is preserved, but the text may become difficult to read when placed outside the user's direct field of vision
Solution Approach 1:
The patent applies different display characteristics to different spatial regions. Text information is displayed with properties adapted to its local position: text near the center of the field of view uses one set of display parameters, while text in peripheral regions uses adjusted parameters such as larger font sizes, increased contrast, or different positioning strategies to ensure readability while maintaining spatial accuracy.
Solution Approach 2:
The display system dynamically adjusts text properties based on the user's head orientation and the position of sound sources. As the user turns their head, the text positions and characteristics are updated in real-time to maintain both spatial correspondence and optimal readability, creating a dynamic adaptation to the user's changing viewing conditions.
Data Source
AI summary
According to an embodiment, a display control system includes a recognizer, a calculator, and a display controller. The recognizer is configured to recognize sound generated from a sound source. The calculator is configured to calculate a first direction of the sound source from a position of a user based at least in part on the recognized sound. The display controller is configured to cause a display to output display information that visually expresses the sound in a first display format determined based at least in part on an angle between a second direction in which the user faces and the first direction of the sound source.