Projection Image Compensation Using Supplementary Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing projection image technologies face issues with discontinuous sections and occlusions in indoor spaces, leading to incomplete or incorrect RGB information when viewed from arbitrary positions, limiting user experience and increasing computational complexity.
Innovation Solution
A method and apparatus that acquire mesh data, representative images, and supplementary images, using index matrices to detect and correct discontinuous and occluded faces by extracting pixel information from supplementary images, ensuring complete RGB definition across arbitrary views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple images are used for texture mapping in large indoor spaces, then coverage area is improved, but discontinuous sections and RGB information loss occur at boundaries
Solution Approach 1:
The patent performs preliminary actions by acquiring supplementary images at multiple positions before final texture mapping. These supplementary images are pre-acquired to cover potential discontinuous sections, allowing the system to extract and fill in missing RGB information from these pre-acquired images during the texture mapping process, thus preventing information loss at boundaries.
Solution Approach 2:
The patent introduces supplementary images as intermediary elements between the main representative images. These supplementary images act as mediators that bridge the gaps between adjacent representative images, providing the necessary RGB information for faces that would otherwise be discontinuous or missing at image boundaries.
2Area of stationary object
If image acquisition area is enlarged to cover more space, then coverage is improved, but computational complexity and data processing burden increase
Solution Approach 1:
The patent segments the texture mapping process into distinct stages: first identifying discontinuous sections using representative images, then selectively extracting and processing only the necessary supplementary images for those specific sections. This segmentation allows the system to handle large coverage areas by processing data in manageable chunks rather than attempting to process all images simultaneously.
Solution Approach 2:
The patent applies local quality by extracting and processing supplementary images only in the specific regions where discontinuous sections are detected, rather than uniformly processing all acquired images. This selective approach reduces computational complexity by focusing processing resources only on areas that need supplementation, while maintaining comprehensive coverage.
3Manufacturing precision
If vertex positions are adjusted to prevent face division at boundaries, then RGB continuity is improved, but mesh adjustment complexity increases
Solution Approach 1:
Instead of adjusting vertex positions to prevent face division (the conventional approach), the patent inverts the approach by keeping the mesh structure unchanged and instead adjusting the texture mapping process. The system extracts RGB information from supplementary images for discontinuous sections and applies this information to the corresponding mesh faces, achieving continuity without modifying the mesh geometry.
Data Source
AI summary
The projection image compensating method according to an embodiment of the present disclosure includes acquiring mesh data, at least one representative image, at least one supplementary image, and position information which is information about an obtaining pose of each image for an indoor space; adding an index of each of the plurality of faces to a matrix corresponding to a size of the at least one representative image in accordance with a result of projecting the plurality of faces which configures the mesh data to the at least one representative image; detecting at least one occluded face among the plurality of faces, using an index added to the matrix; and extracting pixel information which is information of a pixel value corresponding to the at least one occluded face from the at least one supplementary image.


