3D Display Amblyopia Diagnosis via Eye Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current naked-eye 3D display technologies face challenges in accurately projecting images to multiple viewers without eyewear, leading to poor user experience due to inadequate gaze tracking and eye positioning analysis, which is crucial for diagnosing and treating amblyopia effectively.
Innovation Solution
The implementation of deep learning systems for face detection, eye tracking, and gaze direction analysis to personalize 3D projections based on individual viewer data, including face and eye landmark detection, head pose estimation, and visual acuity assessment, allowing for dynamic adjustment of image projections to ensure accurate rendering for each viewer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If naked-eye 3D display technologies are used to project images to multiple viewers, then the ability to provide 3D viewing experience is improved, but the accuracy of gaze tracking and eye positioning analysis deteriorates
Solution Approach 1:
The patent implements personalized 3D rendering by detecting individual eye characteristics (pupil ellipses, iris patterns) and head pose for each viewer, then generating customized stereoscopic image pairs tailored to each person's anatomy and viewing geometry. This local customization resolves the contradiction by ensuring each viewer receives optimized 3D content while the system maintains accurate gaze tracking through dedicated computer vision algorithms.
Solution Approach 2:
The system performs preliminary face detection, eye landmark identification, and head pose estimation before generating 3D content. By pre-characterizing each viewer's eye geometry and viewing position, the system establishes accurate baseline measurements that enable both high-quality personalized rendering and precise gaze tracking throughout the viewing session.
2Measurement precision
If deep learning systems are implemented for personalized 3D projections, then the accuracy of visual acuity assessment is improved, but the device complexity increases
Solution Approach 1:
The patent employs unsupervised deep learning models that automatically learn eye anatomy characteristics and gaze patterns from raw video data without requiring manual annotation or calibration sessions. The system self-calibrates by detecting pupil ellipses and iris patterns, then uses these learned models to perform both visual acuity assessment and drive 3D rendering, eliminating the need for complex external calibration equipment or expert intervention.
Solution Approach 2:
The deep learning system serves multiple functions simultaneously: it detects face landmarks, tracks eye gaze, assesses visual acuity, and generates personalized 3D content all through integrated computer vision pipelines. This multi-functionality reduces overall system complexity by consolidating what would otherwise require separate specialized subsystems into a unified deep learning framework.
3Ease of operation
If 3D projections are dynamically adjusted for each viewer, then the user experience is improved, but the processing time and computational resources increase
Solution Approach 1:
The system performs preliminary detection of face landmarks, eye positions, and head pose, then caches these geometric parameters for use during 3D content generation. By pre-computing viewer-specific viewing geometry and storing it for reuse, the system minimizes real-time processing requirements while maintaining personalized rendering quality throughout the viewing session.
Solution Approach 2:
The patent implements foveated rendering that concentrates computational resources on the central foveal region where viewers fixate their gaze, using detected eye tracking data to allocate higher resolution processing to areas of visual interest while reducing processing in peripheral regions. This localized resource allocation maintains perceived quality while reducing overall computational burden.
Data Source
AI summary
Methods, systems, and storage media for projecting a viewer-specific 3D object perspectives from a single 3D display are disclosed. Implementations may: acquire face and eye region image data of a plurality of viewers within a field of view of at least one camera associated with a 3D-enabled digital display; analyze the eye region image data to determine at least one 3D eye position, at least one eye state, at least one gaze angle, and at least one point-of-regard for a viewer relative to at least one camera associated with the 3D-enabled digital display; and calculate a plurality of processed image projections for display by the single 3D display. The digital-processing of input image projection enables a separate optical input to the user's eyes, and by the use of visual-acuity pre-processing of the image—via visual-field kernel, enables the treatment of eye abbreviations, including an Amblyopic-eye without the need for any additional eye-ware, or head-up-displays (HMD's).


