Autostereoscopic 3D Display With Head-Tracked Spatial Audio
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional autostereoscopic displays fail to provide a realistic audiovisual experience as sound perception does not adjust to a viewer's head movement, and interaction with the displayed scene does not correspond with the associated sound.
Innovation Solution
Adapt both the three-dimensional image and sound to the position of the viewer's eyes and ears relative to the autostereoscopic display using an eye tracking system, virtual cameras, and microphones to ensure synchronized visual and auditory perspective changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If sound is optimized for a specific viewer position using conventional loudspeaker systems, then sound perception is improved at that position, but the immersive experience deteriorates when the viewer moves their head
Solution Approach 1:
The patent implements dynamic sound field adjustment by continuously tracking eye position and recalculating sound parameters in real-time. The sound reproduction system adapts to the viewer's head movements by dynamically modifying the acoustic environment, ensuring that sound perception remains accurate regardless of the viewer's position or orientation.
Solution Approach 2:
The system uses eye tracking data as feedback to continuously adjust sound parameters. By monitoring the viewer's eye position and using this information to modify the sound field in real-time, the system maintains accurate sound perception while adapting to head movements, resolving the contradiction between precision and adaptability.
2Measurement precision
If head phones or earbuds are used to improve sound perception, then sound quality is improved, but the immersive experience deteriorates due to unnatural peripherals
Solution Approach 1:
The patent creates a virtual acoustic environment that copies the characteristics of natural sound propagation. By using eye tracking to determine viewer position and rendering sound accordingly, the system replicates how sound would naturally behave in the real world, providing accurate sound perception without requiring physical headphones or earbuds.
Solution Approach 2:
The system replaces the mechanical solution of headphones with an optical-acoustic integration approach. Instead of using a separate mechanical audio device, the patent integrates sound delivery through the display system itself, using eye tracking data to direct and adjust sound fields, thereby maintaining natural viewing experience while improving sound perception.
3Device complexity
If conventional loudspeaker systems are used for sound output, then device complexity is reduced, but the synchronized audio-visual interaction deteriorates during viewer interaction with displayed content
Solution Approach 1:
The patent makes the display system multi-functional by integrating both visual and auditory delivery capabilities within a single device. The display system not only presents visual content but also delivers spatially accurate sound based on eye tracking data, eliminating the need for separate conventional loudspeaker systems while enabling synchronized audio-visual interaction during user engagement with displayed content.
Data Source
AI summary
The invention relates to method for simultaneously presenting to a viewer of an autostereoscopic display device a three-dimensional image and three-dimensional sound, wherein the method comprises adapting the three-dimensional image as well as the three-dimensional sound to the position of the eyes and the ears of the viewer relative to the autostereoscopic display device. In this way, image and sound of one and the same virtual scene can simultaneously be presented to a viewer as if they were of a real scene; both are experienced three-dimensionally and in accordance with movement of the viewer in the scene. Moreover, this is also achieved for interactions of a viewer with the scene, e.g. with virtual objects displayed on the autostereoscopic display device. In this way, the viewer is provided with an increased immersion in the scene, which may find a useful application in e.g. teleconferencing and computer gaming.