Mixed Reality Clip Position Adjustment for Optical Misalignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In mixed reality technology, misalignment of the optical axes between the camera and display in head-mounted displays can lead to a reduction in the effective angle of view due to a large shift in the clip position, causing geometric inconsistency between the real and virtual worlds.
Innovation Solution
An image processing apparatus that acquires captured images from different viewpoints, determines initial clip positions, calculates out-of-area amounts for clipped regions, and adjusts these positions to minimize the sum of out-of-area amounts, ensuring optimal geometric consistency and maintaining the display angle of view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the optical axes of the camcorder and display are aligned, then geometric consistency is maintained, but manufacturing precision is difficult to achieve due to assembly errors
Solution Approach 1:
The patent changes the parameter being adjusted from optical axis alignment to clip position adjustment. Instead of trying to physically realign the camcorder and display optical axes (which is difficult due to assembly errors), the system adjusts the software parameter of where to clip the captured image, thereby maintaining geometric consistency through parameter modification rather than physical realignment.
2Reliability
If the clip position is shifted from the center to correct optical axis misalignment, then geometric consistency is improved, but the effective angle of view is reduced
Solution Approach 1:
The patent segments the image processing into multiple captured images from different viewpoints. By dividing the field of view into multiple segments (captured from different angles), the system can select and combine portions that maintain both geometric consistency and maximize the effective display area, rather than simply clipping from a single centered viewpoint.
Solution Approach 2:
The patent introduces a new dimension by capturing images from multiple different viewpoints (spatial dimension). Instead of only adjusting the clip position within a single image plane, the system uses multiple images taken from different spatial positions, allowing it to maintain geometric consistency while preserving more of the original image area through selective combination.
Data Source
AI summary
An image processing apparatus includes an image acquisition unit acquiring a first and second captured images from first and second points of view respectively, an initial value acquisition unit acquiring initial values of respective clip positions to clip display images from the first and second captured images, a derivation unit deriving an amount of a first exterior region of a first display image outside a first region of the first captured image when the first display image is clipped based on the initial values, and deriving an amount of a second exterior region of a second display image outside a second region of the second captured image when the second display image is clipped based on the initial values, and a determination unit determining the respective clip positions to clip the display images from the first and second captured images based on the first and second amounts.