Sound Source Reproduction Device with Visual Attribute Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing sound reproduction methods, such as wave field synthesis, struggle to provide clear understanding of complex content like sports events to listeners unfamiliar with the sounds, as they rely solely on auditory cues, making it difficult for non-experts to comprehend the content effectively.
Innovation Solution
A sound source reproduction device and method that combines sound source information with visual information representing the state and situation of the sound source, using a device with input units for sound and position data, synthesis units to generate virtual sound sources, and display units to present attribute images in real space, allowing listeners to visually understand the sound sources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If wave field synthesis acoustic technique is used to reproduce sound sources in real space, then realistic feeling is improved, but understanding of content by non-expert listeners deteriorates
Solution Approach 1:
The patent combines wave field synthesis acoustic technique with visual information display. The sound source reproduction unit reproduces sound sources in real space while the visual information display unit simultaneously displays images showing positions, movements, and attributes of sound sources. This merging of auditory and visual channels allows non-expert listeners to understand content while maintaining realistic feeling.
Solution Approach 2:
Visual information serves as an intermediary that bridges the gap between complex acoustic information and human comprehension. The display unit provides visual cues about sound source positions, movements, and attributes, making implicit acoustic information explicit and understandable for non-expert listeners without compromising the realistic acoustic experience.
2Reliability
If only sound information is used for content reproduction, then realistic feeling is improved, but ease of understanding by non-experts deteriorates
Solution Approach 1:
The patent adds a visual dimension to the purely auditory reproduction system. By displaying visual information about sound sources in real space, the system provides an additional channel for information transmission that is easier for non-experts to process, while maintaining the realistic acoustic experience in the auditory dimension.
3Loss of information
If visual information is added to sound reproduction, then understanding of content is improved, but device complexity increases
Solution Approach 1:
The system uses a unified real space coordinate system for both sound source reproduction and visual information display. This multi-functionality allows a single system to handle both acoustic and visual information consistently, reducing overall complexity despite adding visual capabilities. The shared spatial reference framework simplifies the integration of multiple information channels.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances the realistic feeling and understanding of content by visually expressing implicit information typically understood by experts, improving the overall experience for listeners by correlating sound with visual representations of the sound sources.
Implementation Method 1
a sound-source-reproduction type sound field reproduction technique that reproduces a spatial and physical wavefront of a sound source on the basis of a physical model, which is one of the multichannel sound field reproduction methods and is called a wave field synthesis acoustic technique
Implementation Method 2
A speaker array including a plurality of speakers outputs sound waves by adjusting a reproduction timing and power for each speaker so as to spatially and physically reproduce wavefronts at virtual sound source positions
Data Source
AI summary
A sound source reproduction device (1) includes: a sound source input unit (11) that inputs sound source information recorded in advance in synchronization with time information; a sound source position input unit (12) that inputs position information of a first sound source at the time; a first sound source attribute input unit (13) that inputs first sound source attribute information for expressing an attribute of the first sound source at the time by using an image and reproducing the attribute in a real space; a sound source synthesis unit (14) that generates a first virtual sound source for reproducing the first sound source in the real space by using the first sound source information and the sound source position information at the time; a sound source reproduction unit (15) that reproduces the virtual sound source in the real space; a first sound source attribute synthesis unit (16) that generates a sound source attribute synthesis image for reproducing the attribute information of the first sound source in the real space by using the position information of the first sound source and the first sound source attribute information; and a sound source attribute display unit (17) that displays the sound source attribute synthesis image in the real space.