Projection-Shooting Posture Detection via Composite Pattern Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for determining the relative posture between a projection unit and a shooting unit, such as those using gray code or checker patterns, are complex and inefficient, particularly when dealing with overlapping projection images, leading to difficulties in accurately detecting pixel correspondences and correcting for luminance and distortion issues in overlap regions.

Innovation Solution

An image processing apparatus and method that utilizes a pattern shot image with multiple sub-patterns, including a start code and unique code, to detect corresponding points between a projection image and a shot image by analyzing the number and positional relationships of sub-patterns, edge images, and centers of gravity, allowing for more accurate detection of pixel correspondences without increasing the number of pattern images required.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If gray code method is used to acquire pixel correspondences, then pixel correspondence detection is possible, but processing becomes complicated and requires many pattern images

Engineering Contradiction:
Improvepixel correspondence detection accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The pattern image is segmented into multiple independent patterns, where each pattern represents specific pixel correspondence information. By dividing the code representation into separate pattern elements rather than using sequential gray code sequences, the system reduces processing complexity while maintaining detection accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of using complex gray code sequences, the invention uses simplified pattern copies that directly represent pixel correspondences. Each pattern serves as a visual copy of the correspondence information, eliminating the need for complex decoding algorithms required by gray code methods.

Inventive Principle:
Principle #26Copying

2Measurement precision

If multiple patterns with different sub-pattern arrangements are used, then pixel correspondence detection accuracy is improved, but the number of pattern images increases

Engineering Contradiction:
Improvecorrespondence detection accuracyVSAvoidnumber of pattern images
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

Multiple patterns representing different pixel correspondences are merged into a single composite pattern image. The pattern image contains multiple patterns simultaneously, allowing the shooting unit to detect all correspondences in one shot rather than requiring multiple separate pattern images.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The invention transitions from temporal sequencing of patterns to spatial arrangement within a single image. Multiple patterns that would traditionally require sequential display are instead arranged in different spatial positions within one pattern image, enabling parallel detection of multiple correspondences.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If traditional methods are used to detect overlap regions, then luminance and distortion correction is possible, but the process is time-consuming and complex

Engineering Contradiction:
Improveluminance and distortion correction accuracyVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

Pixel correspondences are detected in advance using the pattern image method before actual projection begins. By pre-establishing the correspondence map between projector and shooting unit pixels, the system eliminates time-consuming real-time calculations during operation and enables faster luminance and distortion correction.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10349023B2Image processing apparatus and method
Publication Date: 2019.07.09 SONY GROUP CORP
  • US10349023B2 patent drawing
  • US10349023B2 patent drawing
  • US10349023B2 patent drawing

AI summary

The present technology relates to an image processing apparatus and method for enabling a relative posture between a projection unit and a shooting unit to be found more easily. According to one aspect of the present technology, a correspondence between a projection image and its shot image is detected by use of a pattern shot image which is a shot image of a pattern projection image as a projection image of an image including a pattern. The present technology can be applied to an electronic device including a projector or camera or the functions of both, a computer for controlling the same, and the like.