Imaging System for Stereoscopic Views via Gaze and IPD Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional imaging equipment for head-mounted display devices, such as virtual and augmented reality systems, face limitations in accommodating variations in inter-pupillary distance among users due to anatomical differences and focus changes, leading to suboptimal user experiences with mismatched perspective views.
Innovation Solution
An imaging system comprising multiple cameras and a processor that dynamically adjusts camera positions and processes images to simulate the user's inter-pupillary distance and gaze direction, generating accurate left and right perspective views in real-time, allowing for seamless display of virtual or augmented environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If two cameras are arranged at a fixed distance equal to average inter-pupillary distance, then the imaging system is simple and compact, but it cannot accommodate variations in inter-pupillary distance among different users or during user development
Solution Approach 1:
The patent uses multiple fixed cameras to capture images from different positions, then digitally synthesizes the perspective views through image processing. This creates a virtual copy of the user's eye position and gaze direction without physically moving cameras, resolving the contradiction between adaptability and device complexity
Solution Approach 2:
The system changes the parameter of inter-pupillary distance by selecting and combining images from multiple cameras with fixed separations. The processor dynamically adjusts which camera images to use and how to process them based on the user's actual inter-pupillary distance and gaze direction, achieving adaptability without physical movement
2Adaptability or versatility
If two cameras are made movable to adjust separation distance, then the imaging system can adapt to different users and gaze focuses, but the arrangement becomes complex and bulky
Solution Approach 1:
The patent replaces the mechanical system of movable cameras with a digital system. Multiple cameras are fixed in space, and their images are processed computationally to simulate the effect of moving cameras. This substitution eliminates complex mechanical mechanisms while achieving the same adaptive function through software-based image synthesis
3Measurement precision
If two cameras are used with fixed separation, then the device is compact and simple, but the captured images do not match the user's actual perspective views
Solution Approach 1:
The patent segments the imaging function across multiple fixed cameras positioned at different separations. Each camera captures a portion of the scene, and the processor selectively combines these segments to reconstruct the accurate perspective view. This segmentation allows precise perspective representation without requiring a single complex movable camera system
Data Source
Figure 1A~1B
Figure 1C~2B
Figure 2C~3
AI summary
Disclosed is an imaging system (102, 200) for producing images to be displayed to user via a head-mounted display apparatus (104, 210)that comprises means for detecting gaze direction of user. The imaging system comprises a first outer camera (202) and a second outer camera (204), at least one inner camera(110, 206), and processor (112) coupled to aforesaid cameras and means for detecting gaze direction. The processor is configured to (i) obtain inter-pupillary distance of user with respect to user's gaze at infinity; (ii) receive detected gaze direction; (iii) control first outer camera, second outer camera and at least one inner camera to capture first outer image, second outer image and at least one inner image (406A, 406B) of a scene; and (iv)process first outer image and inner image to generate first view of the scene, and process second outer image and inner image to generate second view of the scene, based upon inter-pupillary distance and detected gaze direction.