Flexible Mixed Reality Headset Camera Recalibration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mixed reality display systems with rigid frames may not effectively recalibrate when the spatial relationship between cameras and see-through displays changes, leading to misalignment of virtual and real objects, which affects the user's experience.
Innovation Solution
A method and system for recalibrating a see-through, head-mounted mixed reality display with a flexible frame portion, where outward-facing cameras maintain a fixed spatial relationship with their corresponding displays, allowing for automatic detection and updating of spatial changes using photogrammetry and image processing to maintain accurate registration between real and virtual objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a one-time calibration is performed before shipment, then the manufacturing process is simple and quick, but the alignment accuracy degrades when the flexible frame changes spatial relationships
Solution Approach 1:
The system transitions from static one-time calibration to dynamic continuous recalibration. The flexible frame allows spatial relationships to change dynamically, and the system responds by continuously detecting these changes via cameras and automatically updating the calibration parameters to maintain alignment accuracy throughout the device's usage lifecycle.
Solution Approach 2:
The system implements feedback loops where outward-facing cameras continuously monitor the spatial relationships between cameras and displays. When changes are detected, the system automatically triggers recalibration processes to correct alignment deviations, ensuring ongoing accuracy without requiring manual intervention.
2Adaptability or versatility
If the frame is made flexible to improve comfort and adaptability, then the adaptability increases, but the spatial relationship stability between cameras and displays deteriorates
Solution Approach 1:
The system performs self-calibration using its own cameras to detect spatial relationship changes. The outward-facing cameras automatically identify the relative positions of cameras and displays, and the system autonomously updates calibration parameters without external intervention, maintaining accuracy despite frame flexibility.
Solution Approach 2:
The patent replaces mechanical rigidity with optical-digital compensation. Instead of using a rigid frame to maintain fixed spatial relationships, the system uses camera-based detection and software-based calibration updates to compensate for mechanical flexibility, substituting physical stability with computational correction.
3Measurement precision
If automatic recalibration is implemented to maintain alignment accuracy, then the measurement precision is maintained, but the device complexity increases
Solution Approach 1:
The outward-facing cameras serve multiple functions: they capture images for mixed reality content, monitor spatial relationships for calibration, and detect environmental features. This multi-functionality reduces the need for dedicated calibration hardware, maintaining measurement precision while limiting the increase in device complexity.
Solution Approach 2:
The system uses digital copies of spatial relationships captured by cameras to create virtual models of the physical camera-display geometry. These digital representations are then used for calibration calculations, allowing the system to maintain accuracy through software processing rather than adding complex mechanical calibration mechanisms.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Ensures that virtual objects remain accurately aligned with real objects despite changes in the spatial relationship between cameras and displays, enhancing the user's mixed reality experience by maintaining a consistent and correct mapping of real-world and virtual imagery.
Implementation Method 1
determining a second spatial relationship between the outward facing cameras based on photogrammetry with respect to overlapping image data captured by the outward facing cameras
Data Source
AI summary
The technology provides embodiments for recalibration of outward facing cameras supported by a see-through, head mounted, mixed reality display system having a flexible portion between see-through displays for the eyes. Each outward facing camera has a fixed spatial relationship with a respective or corresponding see-through display positioned to be seen through by a respective eye. For front facing cameras, the fixed spatial relationship allows a predetermined mapping between positions on an image sensor of each camera and positions on the respective display. The mapping may be used to register a position of a virtual object to a position of a real object. A change in a first flexible spatial relationship between the outward facing cameras can be automatically detected. A second spatial relationship between the cameras is determined. A registration of a virtual object to a real object may be updated based on the second spatial relationship.