Projection Masking for Multi-Projector Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge in Projection Mapping (PM) is maintaining image resolution and quality in overlapping areas when multiple projectors are used, due to subtle errors in estimating internal projector parameters and relative object postures, leading to inevitable projection deviations and decreased resolution.

Innovation Solution

An information processing apparatus generates mask information to regulate the intensity of projection light rays for each pixel, determining which projector should irradiate specific areas with maximum or zero intensity, based on depth information and overlapping light ray detection, to prevent projection deviations and maintain image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple projectors are used to perform projection mapping, then the coverage area and projection capability are improved, but projection deviation occurs in overlapping areas due to parameter estimation errors, leading to decreased resolution

Engineering Contradiction:
Improveprojection coverage areaVSAvoidprojection resolution in overlapping area
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The system performs preliminary ray tracing calculations to predict overlapping areas before actual projection. Mask information is generated in advance based on estimated projector parameters and object geometry, allowing the system to pre-determine which projector should illuminate which pixels in overlapping regions, thereby preventing resolution degradation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies different projection strategies to different spatial regions. In non-overlapping areas, both projectors can project normally, while in predicted overlapping areas, the mask information selectively activates only one projector per pixel based on depth information and incident angle calculations, ensuring optimal resolution locally

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If mask information is generated to regulate light ray intensity, then projection deviation is reduced and resolution is improved, but additional processing complexity is introduced

Engineering Contradiction:
Improveprojection accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Instead of physically adjusting projector parameters or adding complex hardware control mechanisms, the system creates a virtual copy of the projection scene through ray tracing simulations. The mask information is generated by copying and processing depth map data and projector parameter data through computational algorithms, replacing complex physical control with simpler information processing

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces mask information as an intermediary layer between the projection images and the actual light output. This intermediate data structure contains pixel-level control information that regulates which projector contributes to each pixel, simplifying the control architecture by decoupling the projection content from the intensity regulation logic

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11134232B2Information processing apparatus, information processing method, and program
Publication Date: 2021.09.28 SONY GROUP CORP
  • US11134232B2 patent drawing
  • US11134232B2 patent drawing
  • US11134232B2 patent drawing

AI summary

There is provided an information processing apparatus, an information processing method, and a program capable of reducing a decrease in resolution in overlapping areas of multiple projection in cases where a plurality of projectors is used to perform the multiple projection onto an object. An information processing apparatus according to one aspect of the present technology generates, in regard to a plurality of projectors irradiating an object serving as a projection target with projection light rays as superimposing light rays depicting a projection image having pixels, mask information for regulating intensity of the corresponding light ray of each pixel of the projection image. The mask information includes information indicating, in regard to the object having a surface including a predetermined position, that the position is irradiated by a predetermined projector. The present technology can be applied to computers each of which causes a plurality of projectors to project images.