Projection Image Compensation Using Supplementary Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing projection image technologies face issues with discontinuous sections and occlusions in indoor spaces, leading to incomplete or incorrect RGB information when viewed from arbitrary positions, limiting user experience and increasing computational complexity.

Innovation Solution

A method and apparatus that acquire mesh data, representative images, and supplementary images, using index matrices to detect and correct discontinuous and occluded faces by extracting pixel information from supplementary images, ensuring complete RGB definition across arbitrary views.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple images are used for texture mapping in large indoor spaces, then coverage area is improved, but discontinuous sections and RGB information loss occur at boundaries

Engineering Contradiction:
Improvecoverage areaVSAvoidRGB information loss
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent performs preliminary actions by acquiring supplementary images at multiple positions before final texture mapping. These supplementary images are pre-acquired to cover potential discontinuous sections, allowing the system to extract and fill in missing RGB information from these pre-acquired images during the texture mapping process, thus preventing information loss at boundaries.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces supplementary images as intermediary elements between the main representative images. These supplementary images act as mediators that bridge the gaps between adjacent representative images, providing the necessary RGB information for faces that would otherwise be discontinuous or missing at image boundaries.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If image acquisition area is enlarged to cover more space, then coverage is improved, but computational complexity and data processing burden increase

Engineering Contradiction:
Improvecoverage areaVSAvoidcomputational complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent segments the texture mapping process into distinct stages: first identifying discontinuous sections using representative images, then selectively extracting and processing only the necessary supplementary images for those specific sections. This segmentation allows the system to handle large coverage areas by processing data in manageable chunks rather than attempting to process all images simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by extracting and processing supplementary images only in the specific regions where discontinuous sections are detected, rather than uniformly processing all acquired images. This selective approach reduces computational complexity by focusing processing resources only on areas that need supplementation, while maintaining comprehensive coverage.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If vertex positions are adjusted to prevent face division at boundaries, then RGB continuity is improved, but mesh adjustment complexity increases

Engineering Contradiction:
ImproveRGB continuityVSAvoidmesh adjustment complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Instead of adjusting vertex positions to prevent face division (the conventional approach), the patent inverts the approach by keeping the mesh structure unchanged and instead adjusting the texture mapping process. The system extracts RGB information from supplementary images for discontinuous sections and applies this information to the corresponding mesh faces, achieving continuity without modifying the mesh geometry.

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS11516448B2Method and apparatus for compensating projection images
Publication Date: 2022.11.29 KOREA UNIV RES & BUSINESS FOUND
  • US11516448B2 patent drawing
  • US11516448B2 patent drawing
  • US11516448B2 patent drawing

AI summary

The projection image compensating method according to an embodiment of the present disclosure includes acquiring mesh data, at least one representative image, at least one supplementary image, and position information which is information about an obtaining pose of each image for an indoor space; adding an index of each of the plurality of faces to a matrix corresponding to a size of the at least one representative image in accordance with a result of projecting the plurality of faces which configures the mesh data to the at least one representative image; detecting at least one occluded face among the plurality of faces, using an index added to the matrix; and extracting pixel information which is information of a pixel value corresponding to the at least one occluded face from the at least one supplementary image.