Stereoscopic Caption Rendering for Stable, Occlusion-Free Z-Plane Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Captions in stereoscopic video can be occluded by objects or cause eye fatigue due to improper placement in the Z-plane, and rapid changes in Z-plane position lead to discomfort for viewers.
Innovation Solution
A system adjusts disparity values for caption rendering using a high-quality per-frame optical flow/disparity map and a fixed bidirectional window to smooth out noisy measurements, iteratively adjusting disparity values in both forward and backward directions to meet a just noticeable difference requirement, ensuring captions are displayed at a stable position in the Z-plane.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If captions are placed closer to the viewer in the Z-plane, then caption visibility is improved, but eye fatigue occurs due to focusing difficulty
Solution Approach 1:
The system dynamically adjusts the Z-plane position parameter of captions based on scene depth analysis. By changing the disparity value parameter, captions are positioned at an optimal depth that balances visibility and viewer comfort, preventing both occlusion and eye fatigue.
Solution Approach 2:
The caption Z-plane position is made dynamic rather than fixed. The system continuously adapts the caption depth position frame-by-frame based on the disparity map analysis, ensuring captions remain in optimal positions relative to moving objects in the scene.
2Object-affected harmful factors
If captions are placed farther from the viewer in the Z-plane, then eye fatigue is reduced, but captions may be occluded by objects in front
Solution Approach 1:
The system performs preliminary analysis of the disparity map before rendering captions. By预先 identifying objects and their depth positions in the scene, the system can proactively position captions at appropriate Z-plane distances to avoid occlusion while maintaining viewer comfort.
Solution Approach 2:
The system adjusts the disparity value parameter of captions based on the depth distribution of objects in the scene. By dynamically changing this parameter, captions are positioned behind occluding objects when necessary while maintaining reasonable distance from the viewer.
3Adaptability or versatility
If the Z-plane position of captions changes drastically over successive frames, then captions can adapt to scene changes, but eye fatigue occurs due to hunting for captions
Solution Approach 1:
The system applies temporal smoothing to the caption Z-plane position changes, creating a periodic or gradual adjustment pattern rather than abrupt changes. This smoothing constraint ensures that caption depth movements are gradual and predictable, reducing viewer discomfort while maintaining scene adaptability.
Solution Approach 2:
The system uses feedback from previous frame's caption positions and current scene analysis to determine optimal caption Z-plane positioning. By considering both historical position data and current scene requirements, the system makes balanced adjustments that adapt to scene changes while minimizing viewer fatigue.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In some embodiments, a method determines a disparity value from a plurality of disparity values in a current frame of a stereoscopic video. The disparity value is based on a difference of a value for a pixel between a first video and a second video of the stereoscopic video. A location is determined in a current frame that include the disparity value. The method analyzes first frames prior to the current frame to adjust disparity values in the first frames to generate one or more adjusted first disparity values. Also, the method analyzes second frames after the current frame to adjust disparity values in the second frames to generate one or more adjusted second disparity values. The one or more adjusted first disparity values and the one or more adjusted second disparity values are output for use in displaying captions in the first video or the second video.