Plenoptic Video Eye-Tracking Focal Plane Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
3-D stereoscopic video systems cause eye-strain due to the inability to focus on objects outside the set depth plane, as they require pre-configured focus areas, limiting user interaction and immersion.
Innovation Solution
A system that generates and displays stereoscopic plenoptic images using eye-tracking technology to dynamically adjust the focal plane based on the viewer's gaze, allowing any part of the image to be brought into sharp focus by capturing and processing the entire light field, enabling multiple depth planes within a single image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional 3-D stereoscopic video is used with a set focus depth plane, then the depth illusion is maintained, but viewers experience eye-strain when trying to focus on objects outside the set depth plane
Solution Approach 1:
The patent applies dynamics by making the focal plane adjustable rather than fixed. The system allows viewers to dynamically change the focal plane from one depth layer to another based on where they want to focus their attention, transforming a static focus constraint into a dynamic adaptation mechanism that eliminates eye-strain while preserving depth illusion.
Solution Approach 2:
The patent changes the parameter of focal plane depth from a fixed value to a variable parameter that can be adjusted by the viewer. By allowing the focal plane to change based on viewer interaction (eye tracking or manual input), the system maintains the depth illusion while eliminating the harmful eye-strain effect of fixed focus.
2Stability of the object's composition
If a fixed focal plane is set in traditional 3-D video, then the depth structure is preserved, but user interaction and immersion are limited
Solution Approach 1:
The system transforms the static focal plane into a dynamic element that responds to user interaction. Viewers can interactively adjust the focal plane to focus on different depth layers, significantly enhancing user interaction and immersion while preserving the depth structure through software-based focus control.
Solution Approach 2:
The patent incorporates feedback mechanisms where viewer attention (detected through eye tracking or other sensors) or manual input directly controls the focal plane adjustment. This feedback loop enhances adaptability and user interaction while maintaining the integrity of the depth structure through intelligent focus management.
3Ease of manufacture
If traditional photography with pre-configured focus area is used, then the capture process is simple, but the area of focus cannot be modified after the picture is taken
Solution Approach 1:
The patent captures all necessary optical information (light field data) during the initial capture phase, storing it in a format that preserves full focus flexibility. This preliminary capture of complete optical information allows the focal plane to be modified after the picture is taken, combining the simplicity of traditional capture with post-capture focus adaptability.
Solution Approach 2:
The system enables dynamic focus adjustment after capture by storing light field information that allows software-based refocusing. This transforms the static focus constraint of traditional photography into a dynamic system where the focal plane can be changed after the image is captured, enhancing versatility while maintaining capture simplicity.
Data Source
AI summary
Described herein is a system and method for displaying a stereoscopic plenoptic image or video to a user, with eye-tracking capabilities. A display device displays a plenoptic image or video on a screen, and focuses the plenoptic image or video at the depth plane corresponding to the eye-coordinates of the user's gaze. The focused depth plane in the displayed plenoptic frame updates as the frames progress in the video stream, thereby constantly re-focusing the depth plane of the currently displayed plenoptic frame depending on the location of the user's gaze.