3D Display Apparatus Using Gaze Detection for VOR Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D display technology fails to dynamically adjust the display based on a viewer's head movements, leading to abnormal jitter and discomfort due to the inability to detect actual gaze positions, especially when the viewer turns their head, resulting in a gap between the images seen by each eye and the actual perception.
Innovation Solution
A display apparatus and method that incorporates a camera and processing circuit to recognize the face and sight directions of a viewer, enabling a vestibulo-ocular reflex (VOR) compensation mode and dynamically adjusting the rendering mode between 3D and 2D based on the viewer's field of view, ensuring a stable and comfortable viewing experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional 3D display technology is used without gaze detection, then the display system is simple and easy to implement, but abnormal jitter occurs when the viewer turns their head and there is a gap between the images seen by each eye and actual perception
Solution Approach 1:
The patent introduces a camera as an intermediary device to detect the viewer's gaze position and head orientation. The camera captures images of the viewer's face and eyes, and the processing circuit analyzes these images to determine gaze direction and head pose, which then triggers appropriate 3D display modes. This intermediary detection system resolves the contradiction by providing reliable gaze information without requiring complex direct neural or ocular measurement systems.
Solution Approach 2:
The system implements a feedback loop where the camera continuously monitors the viewer's gaze and head position, the processing circuit analyzes this information, and the 3D display dynamically adjusts its rendering based on the detected parameters. This feedback mechanism ensures the display remains stable and aligned with the viewer's actual perception, resolving the jitter and perception gap issues while maintaining manageable system complexity through iterative adjustment.
2Ease of operation
If 3D rendering mode is enabled for the entire screen, then the 3D effect is strong, but the viewer may feel dizzy and discomfort when turning their head due to mismatch between left and right eye images
Solution Approach 1:
The patent dynamically adjusts the 3D rendering mode based on real-time detection of the viewer's head orientation and gaze position. When the head is turned or gaze direction changes, the system switches from full 3D rendering to 2D rendering or selective 3D rendering for specific regions. This dynamic adaptation resolves the contradiction by maintaining user comfort through mode switching while preserving 3D perception accuracy when the viewer is in a proper viewing position.
Solution Approach 2:
The system applies different rendering qualities to different regions of the display based on the detected field of view. Instead of uniformly applying 3D rendering across the entire screen, the patent enables 3D rendering only for regions within the viewer's current field of view, while displaying 2D content for regions outside the field of view. This local differentiation maintains comfort during head movements while preserving 3D accuracy in the relevant viewing area.
3Measurement precision
If the system detects only 2D face landmarks with parallel movement, then the detection system is simple, but it cannot detect actual gaze position when the head turns up/down or left/right
Solution Approach 1:
The patent segments the face detection process into multiple hierarchical levels: first detecting 2D face landmarks for basic positioning, then detecting 3D eye landmarks for gaze direction, and finally analyzing head pose from multiple facial features. This segmentation allows the system to achieve high measurement precision by combining simple 2D detection with more sophisticated 3D eye analysis, while managing algorithmic complexity through a staged processing approach where each level builds on the previous one.
Data Source
AI summary
A display apparatus and an operation method thereof are provided. The display apparatus includes a 3D display module, a camera, and a processing circuit coupled to the 3D display module and the camera. The camera is configured to shoot a viewing field of the 3D display module to generate a photo. The processing circuit is configured to output an image stream to the 3D display module to display a screen, and recognize the photo to obtain a face direction and a sight direction of a person in the viewing field. The processing circuit determines whether to enable a vestibulo-ocular reflex (VOR) compensation mode for the image stream according to the face direction and the sight direction.