Projector Coordinate Correction for Non-Fixed Camera Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing projection methods fail to adapt to changes in the positional relationship between a projector and a projection target object when using a separate and non-fixed image pickup device, such as a smartphone or tablet, which can lead to discrepancies in the projected image on the target.

Innovation Solution

A method that involves projecting a first image, picking up and storing images using a separate image pickup device, specifying correspondences between projector and camera coordinate systems, generating correction information based on feature points in converted images, and adjusting the projection to correct for positional changes, allowing the projector to adapt to changes in its relationship with the projection target.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a separate and non-fixed image pickup device is used to pick up images of the projection target object, then the ease of operation is improved, but the measurement precision of the positional relationship deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidmeasurement precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system continuously captures images of the projection target object with the image pickup device, detects feature points, and updates correction information based on the detected positional relationship. This feedback loop allows the system to adapt to changes in real-time, maintaining measurement precision even with a non-fixed image pickup device.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system creates a virtual model of the projection target object by mapping feature points from the image pickup device's coordinate system to the projector's coordinate system. This copying approach allows accurate positional relationship measurement without requiring the image pickup device to be physically fixed.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If correction information is continuously updated based on new images, then the adaptability to positional changes is improved, but the loss of time for image processing increases

Engineering Contradiction:
ImproveadaptabilityVSAvoidloss of time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

Instead of processing all pixels in the captured images, the system selectively detects only feature points that represent the positional relationship between the projector and the projection target object. This partial processing approach reduces computation time while maintaining adaptability to positional changes.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system pre-identifies and tracks specific feature points on the projection target object that are most indicative of positional changes. By focusing on these predetermined feature points, the system can quickly update correction information without extensive processing of the entire image.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11743436B2Projection method and non-transitory computer-readable storage medium storing a program
Publication Date: 2023.08.29 SEIKO EPSON CORP
  • US11743436B2 patent drawing
  • US11743436B2 patent drawing
  • US11743436B2 patent drawing

AI summary

A projection method including specifying a first correspondence between a projector coordinate system and a camera coordinate system, based on a first picked-up image and a first image, determining a second correspondence between the projector coordinate system and the camera coordinate system, based on a second picked-up image and a second image, generating correction information, based on one or a plurality of first feature points in a third image acquired by converting the first picked-up image into the projector coordinate system, based on the first correspondence, and one or a plurality of second feature points corresponding to the one or plurality of the first feature points, in a fourth image acquired by converting the second picked-up image into the projector coordinate system, based on the second correspondence, and projecting the projection image that is corrected based on the correction information.