HMD Auto Exposure Segmentation for Position Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video see-through Head-Mounted Display (HMD) systems face challenges in maintaining accurate position and orientation calculations due to changes in external brightness, as the Auto Exposure function affects both image capturing for mixed reality and position/orientation determination, leading to potential overexposure and reduced accuracy.
Innovation Solution
The implementation of separate Auto Exposure control for image capturing units used for mixed reality and position/orientation determination, with a system that obtains luminance values and tracking parameters to set optimal image capturing parameters for each unit, ensuring consistent brightness and accurate image capture even with changing environmental conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single image capturing unit is used for both mixed reality capture and position/orientation determination, then device complexity is reduced, but measurement precision of position and orientation deteriorates due to Auto Exposure affecting both functions
Solution Approach 1:
The patent divides the image capturing function into two separate image capturing units: one dedicated to mixed reality capture and another dedicated to position and orientation determination. This segmentation allows each unit to have optimized exposure control settings, preventing the Auto Exposure function from interfering with the accuracy of position and orientation measurements while maintaining device functionality.
2Adaptability or versatility
If Auto Exposure function is enabled for image capturing unit used in position and orientation determination, then adaptability to changing brightness conditions is improved, but measurement precision of position and orientation deteriorates due to overexposure
Solution Approach 1:
The patent separates the image capturing units so that the unit used for position and orientation determination does not have the Auto Exposure function enabled, while another unit handles Auto Exposure for mixed reality capture. This segmentation allows adaptability to brightness changes in the displayed image without compromising the measurement precision of position and orientation.
3Illumination intensity
If Auto Exposure control is applied to image capturing for position and orientation, then image quality under varying brightness is improved, but position and orientation determination accuracy deteriorates due to brightness changes in captured image
Solution Approach 1:
The patent implements separate image capturing units with differentiated functions: one unit captures images for mixed reality with Auto Exposure control to ensure image quality under varying brightness, while another unit captures images for position and orientation determination without Auto Exposure to maintain consistent brightness and measurement accuracy.
Solution Approach 2:
The patent applies different quality characteristics to different parts of the image processing system: the mixed reality image capturing unit has Auto Exposure enabled for optimal image quality, while the position and orientation determination unit has Auto Exposure disabled to maintain local consistency in brightness for accurate feature detection and measurement.
Data Source
AI summary
An information processing apparatus comprises a luminance value obtaining unit for respectively obtaining first and second luminance values of first and second captured images of a physical space, wherein the first and second captured images are respectively captured by first and second image capturing units; a parameter obtaining unit for respectively obtaining first and second tracking parameters of automatic exposure control corresponding to a change in brightness of the physical space for the first and second image capturing units; and a setting unit for setting a first image capturing parameter for the first image capturing unit based on the first luminance value and the obtained first tracking parameter and a second image capturing parameter for the second image capturing unit based on the second luminance value and the obtained second tracking parameter.