Arbitrary Shape Projection via Camera Path Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing projection systems face difficulties in determining non-quadrangular regions, as described in JP-A-2014-186104, which limits their ability to accurately detect and project arbitrary shapes within a projection range.

Innovation Solution

A method and system that includes a projector and a portable apparatus with a camera, where the projector projects a pattern image, and the camera captures image data to determine a path based on changes in the image data, allowing the generation of a filter that alters the projected image within a defined range, enabling the projection of arbitrary shapes, including those that are not quadrangular.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a quadrangular region detection method is used, then the detection process is simple, but non-quadrangular regions cannot be determined

Engineering Contradiction:

Improveability to determine arbitrary shapesVSAvoidcomplexity of path determination method

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transforms the static quadrangular region detection into a dynamic path tracing process. The camera moves along an arbitrary path while capturing image data, and the system dynamically determines the projection region based on the captured data changes. This allows the system to adapt to any shape rather than being limited to fixed quadrangular regions.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes the detection parameter from fixed corner points to continuous image data changes along a path. By monitoring how image data varies as the camera moves through the projection region, the system can determine arbitrary shapes. The key parameter change is from discrete corner coordinates to continuous intensity variations along the traced path.

Inventive Principle:

Principle #35Parameter changes

2Measurement precision

If the camera captures image data along an arbitrary path, then non-quadrangular regions can be determined, but the detection process becomes more complex

Engineering Contradiction:

Improveaccuracy of region determinationVSAvoiddifficulty of path-based detection

Core Design Contradiction:

Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent replaces complex mechanical path planning with optical field analysis. Instead of mechanically controlling the camera to follow precise geometric paths, the system uses the camera to capture optical intensity variations and automatically determines the projection region boundary based on where the intensity changes from projected to non-projected areas. This substitution of mechanical control with optical field analysis simplifies the detection process while maintaining high precision.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If image data changes are used to determine the path, then arbitrary shapes can be detected, but processing complexity increases

Engineering Contradiction:

Improveflexibility in projection region shapeVSAvoidcomplexity of image data processing

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts only the essential information from image data - the boundary where projected and non-projected regions meet. Instead of processing the entire image dataset, the system identifies and extracts the transition points where image intensity changes, which define the projection region boundary. This extraction of critical boundary information reduces processing complexity while maintaining the ability to determine arbitrary shapes.

Inventive Principle:

Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for precise determination and projection of arbitrary shapes, including non-quadrangular regions, within the projection range, enhancing the system's versatility and accuracy by using image data to define the path and apply filters accordingly.

Implementation Method 1

a projector and a portable apparatus including a camera, the method including causing the projector to project light representing a pattern image, acquiring image data from the camera that captures the light

Methodology Applied

Scientific EffectLight: Light

Data Source

PatentUS11228744B2Method for controlling projection system, projection system, and control program

Publication Date: 2022.01.18 SEIKO EPSON CORP

AI summary

A method for controlling a projection system including a projector and a portable apparatus including a camera includes causing the projector to project light representing a pattern image, acquiring image data from the camera that captures the light, determining a path in the pattern image based on a change in the image data according to displacement of the camera, and generating a filter that changes a portion of an image projected by the projector in the range defined by the path.