Projection System Control via Marker Image Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing projection systems face challenges in adjusting their projection range effectively, particularly when capturing images projected by multiple projectors, as they struggle to align and correct distortions across overlapping regions, leading to incomplete or distorted images.

Innovation Solution

A control device and method that uses a processor to project a second image with marker images based on the capturing results from an imaging apparatus, allowing for adjustment of the projection range by calculating the imageable range and projecting partial images that can be accurately captured, enabling distortion correction and alignment across multiple projectors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the projection apparatus projects a first image including a plurality of marker images to capture the entire projection range, then the measurement precision of the projection range is improved, but the imaging apparatus cannot capture the entire image due to limited field of view, leading to incomplete capturing

Engineering Contradiction:
Improveprojection range measurementVSAvoidimageable range
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The first image is divided into multiple second images, each containing a subset of marker images that can be captured within the imaging apparatus's field of view. The processor projects these segmented second images sequentially, allowing the imaging apparatus to capture each portion separately. This segmentation resolves the contradiction by making the large projection range measurable through multiple smaller, captureable segments.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The processor preliminarily determines the imageable range of the imaging apparatus before projection adjustment. Based on this preliminary determination, the processor generates appropriate second images that fit within the captureable area. This preliminary action ensures that the projection is optimized for the actual capture capabilities, preventing incomplete capturing while maintaining measurement precision.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If the projection apparatus adjusts the projection range to cover a wide area, then the adaptability of the projection system is improved, but the distortion correction and alignment across overlapping regions becomes more difficult

Engineering Contradiction:
Improveprojection range coverageVSAvoiddistortion correction complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Marker images serve as intermediaries between the projection apparatus and the imaging apparatus. These markers are projected onto the projection surface and captured by the imaging apparatus, providing reference points for the processor to calculate transformation matrices. This intermediary approach simplifies distortion correction and alignment by providing clear, detectable reference points that facilitate accurate geometric transformations across the wide projection range.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The processor projects multiple second images that are copies or portions of the original first image, each containing specific marker images. These copied segments can be independently captured and then reassembled by the processor using calculated transformation matrices. This copying approach enables wide area coverage while maintaining manageable complexity in distortion correction, as each copied segment can be processed independently.

Inventive Principle:
Principle #26Copying

3Ease of operation

If the imaging apparatus captures only a part of the projected image, then the ease of operation is improved by avoiding complex alignment, but the completeness of the captured image deteriorates

Engineering Contradiction:
Improveimage capturing operationVSAvoidimage completeness
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The imaging apparatus captures second images containing marker images, and the processor uses these captured images as feedback to calculate transformation matrices. Based on this feedback, the processor determines the appropriate projection parameters for the first image. This feedback loop ensures that the captured partial images are sufficient and properly positioned, maintaining image completeness while keeping the operation simple and automated.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs self-service by automatically generating appropriate second images based on the imaging apparatus's imageable range, projecting them, capturing them, and using the captured images to determine projection parameters for the complete first image. This self-service approach eliminates the need for manual alignment and ensures complete image capture through automated coordination between projection and capture operations.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11895444B2Control device, control method, projection system, and control program
Publication Date: 2024.02.06 FUJIFILM CORP
  • US11895444B2 patent drawing
  • US11895444B2 patent drawing
  • US11895444B2 patent drawing

AI summary

A control device of a projection system includes one or more projection apparatuses that project a first image including a plurality of marker images, and an imaging apparatus that captures at least a part of the first image, the control device includes a processor, and the processor is configured to perform a control of projecting a second image including a plurality of marker images from the projection apparatus based on a capturing result of at least the part of the first image by the imaging apparatus.