See-Through Image Projection Mapping for Viewpoint Continuity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies do not provide a clear method for setting a region in a captured image to be displayed and performing coordinate conversion, leading to discontinuity between the displayed image and the actual scenery viewed by the occupant, causing unnaturalness.
Innovation Solution
An information processing device that includes an information acquisition unit, display processing unit, first and second conversion information acquisition units, and an image generation unit to accurately convert and display a see-through image, aligning the displayed image with the occupant's viewpoint, using projection conversion matrices to map the captured image onto a display unit.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If coordinate conversion is performed without a clear method for setting display region and conversion parameters, then the display process is simplified, but the continuity between displayed image and actual scenery deteriorates, causing unnaturalness
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing conversion information (projection center coordinates, reference range, coordinate conversion formulas) before actual image display. The processor identifies the projection center corresponding to the occupant's viewpoint and calculates the reference range on the set plane in advance, so that when image display is needed, the pre-computed conversion parameters are already available, ensuring both ease of operation and accuracy.
Solution Approach 2:
The patent introduces an intermediary element - the conversion information (projection center and reference range) - that mediates between the captured image coordinate system and the display unit coordinate system. This intermediary contains the mathematical relationships and transformation parameters needed to accurately map images while maintaining continuity with the actual scenery, thus resolving the contradiction between simple display process and accurate image continuity.
2Manufacturing precision
If the projection center and reference range are accurately calculated based on occupant's viewpoint, then the image continuity is improved, but the calculation complexity increases
Solution Approach 1:
The patent segments the complex coordinate conversion process into distinct functional modules: (1) identifying the projection center corresponding to the occupant's viewpoint, (2) calculating the reference range on the set plane based on the projection center, (3) generating conversion information containing transformation formulas, and (4) applying this conversion information to map the captured image. This segmentation reduces calculation complexity by breaking down the overall task into manageable, independent steps that can be executed systematically.
Solution Approach 2:
The patent applies preliminary action by pre-calculating the projection center coordinates and reference range parameters before actual image processing. These pre-computed values are stored as conversion information and reused for multiple image displays, avoiding redundant calculations and reducing the computational burden during real-time operation while maintaining high image continuity accuracy.
3Speed
If conversion information is pre-calculated and stored for coordinate transformation, then the processing speed is improved, but the memory requirements increase
Solution Approach 1:
The patent extracts only the essential conversion information needed for coordinate transformation - specifically the projection center coordinates and reference range parameters that define the transformation from captured image coordinates to display unit coordinates. By extracting and storing only these critical parameters rather than entire image datasets or complex transformation algorithms, the system achieves fast processing speed while minimizing memory storage requirements.
Data Source
AI summary
An image generation device calculates a projection conversion matrix serving as a first conversion information enabling conversion of coordinates of a captured image from a coordinate system of the image to a coordinate system of a vehicle, calculates a projection conversion matrix serving as second conversion information enabling conversion of coordinates of a reference range to be displayed on a display unit from the coordinate system of the vehicle to a coordinate system of the display unit, and makes an image generation unit generate a display target image using the projection conversion matrices.