Eyeball Image-Based AR Display Alignment for HMDs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In head-mounted display (HMD) systems, the accuracy of displaying augmented reality (AR) images is compromised when the relative positional relationship between the user's viewpoint and the coordinate system changes, leading to displacement of the displayed images and reduced display accuracy.
Innovation Solution
An information processing apparatus that captures images of the real space reflected on the user's eyeball and the AR images displayed on a transmissive display unit, using an acquisition unit and a display control unit to control image display based on these images, including an image generation unit for transforming real space coordinates into display coordinates and a correction unit for adjusting the positional relationship between reference elements in the images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the position of displayed additional information is adjusted according to a predetermined coordinate system, then the display can be controlled systematically, but the position becomes displaced when the relative positional relationship between the viewpoint and coordinate system changes, reducing display accuracy
Solution Approach 1:
The patent replaces the mechanical coordinate system adjustment method with an optical imaging method. Instead of adjusting display positions based on predetermined coordinate systems that require mechanical alignment, the system captures images of the eyeball and uses image processing to determine the relative positional relationship between the viewpoint and coordinate system, thereby eliminating mechanical alignment errors and improving display accuracy.
Solution Approach 2:
The patent creates a visual copy of the coordinate system and viewpoint relationship through imaging. By capturing images of the eyeball and processing these images to extract positional information, the system creates a visual representation of the spatial relationship, allowing for accurate determination and correction of display positions without direct mechanical measurement.
2Measurement precision
If individual calibration is performed for each user to achieve high accuracy, then display precision improves, but the complexity of the system increases due to calibration procedures
Solution Approach 1:
The patent enables the system to automatically perform calibration without requiring user intervention or complex calibration procedures. The eyeball imaging system automatically captures the user's visual field, processes the images to determine positional relationships, and adjusts display positions accordingly, making the calibration process transparent and eliminating the need for manual setup.
Solution Approach 2:
The patent accelerates the calibration process by using rapid image capture and processing techniques. Instead of slow manual calibration procedures, the system quickly captures eyeball images, processes them through automated algorithms, and completes the calibration in a fraction of the time, effectively 'accelerating' what would otherwise be a lengthy process.
Data Source
AI summary
An information processing apparatus according to an embodiment of the present technology includes an acquisition unit; and a display control unit. The acquisition unit is capable of acquiring a first image obtained by capturing an image of a real space reflected on a user's eyeball, and a second image obtained by capturing an image related to the real space displayed on a predetermined display unit, the real space displayed on the predetermined display unit being reflected on the eyeball. The display control unit controls, on a basis of the acquired first image and the acquired second image, image display performed by the predetermined display unit.