Display Apparatus Synchronizing Video Viewpoint and Audio Source Position
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional display apparatuses struggle to synchronize video and audio output for omni-directional content, resulting in a poor sense of presence for users, as they often fail to adjust video and audio states in response to user interactions, leading to mismatched display and sound outputs.
Innovation Solution
A display apparatus equipped with a video processor to adjust image display based on user input and an audio processor to determine acoustic features of the audio signal, optimizing the audio output by distinguishing between live and post-process recordings, and adjusting sound levels and source positions accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional video and audio reproduction methods are used for omni-directional content, then the display apparatus can reproduce content, but the display state of image and output state of sound do not match, resulting in poor sense of presence
Solution Approach 1:
The patent implements dynamic adjustment of both video display and audio output based on real-time user input. The video processor changes the displayed image viewpoint in response to user input, and the audio processor simultaneously adjusts sound output to match the changed viewpoint, creating synchronized video-audio experience that adapts to user interactions
Solution Approach 2:
The system incorporates feedback mechanisms where user input is detected and processed to generate corresponding video and audio adjustments. The audio processor receives feedback about the user's viewpoint change and adjusts the audio output accordingly, ensuring that the sound direction and volume are synchronized with the visual display changes
2Adaptability or versatility
If the display apparatus adjusts video output in response to user input, then the display state can be optimized, but the audio output may not be synchronized without additional adjustment
Solution Approach 1:
The patent merges the video processing and audio processing functions into a coordinated system. The video processor and audio processor work together to simultaneously adjust their outputs based on the same user input, ensuring that video display changes and audio output changes are synchronized and match each other
3Reliability
If the audio processor adjusts sound output based on acoustic features, then the acoustic environment is optimized, but the complexity of the audio processing increases
Solution Approach 1:
The audio processor changes audio parameters such as sound direction, volume, and acoustic characteristics based on the detected acoustic features and user input. By dynamically adjusting these parameters, the system optimizes the acoustic environment to match the visual display state and user interactions without requiring complex hardware modifications
Data Source
AI summary
A display apparatus including: a display; a loudspeaker; a user input unit; a video processor configured to process a video signal to be displayed as an image on the display, and change a viewpoint of the image displayed on the display in response to a user input made through the user input unit; and an audio processor configured to process an audio signal to be output as a sound from the loudspeaker, determine acoustic features of the audio signal, and adjust the output of the sound from the loudspeaker according to the acoustic features in response to the user input.