Image Processing Apparatus Using Circular Marker Projection Transform

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing technologies for generating free viewpoint images require professional equipment and markers with identifiers, making it difficult for general users to effectively capture and utilize free viewpoint images.

Innovation Solution

An image processing apparatus that receives image data from multiple viewpoints, performs calibration using circular markers drawn on a sheet, and generates a free viewpoint image by projecting the elliptical figures into exact circles for marker identification and camera parameter estimation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional image processing technology uses markers with identifiers or characteristic information, then the marker can be specified through image recognition, but it becomes difficult for general users to prepare and use such markers effectively

Engineering Contradiction:
Improvemarker specification accuracyVSAvoiduser accessibility
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces complex markers with identifiers or characteristic information with simple circular markers that are easy to prepare and use. The circular marker is a disposable, simple object that any user can create without specialized knowledge, eliminating the need for complex marker preparation while maintaining sufficient accuracy for image processing operations.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent changes the marker parameter from complex identifiers or characteristic information to simple geometric shape (circle). This parameter change simplifies the marker while maintaining its functionality for image recognition and camera calibration, making it accessible to general users without sacrificing measurement precision.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If multiple image capturing apparatuses are arranged around an image capturing target, then free viewpoint images can be generated, but the device complexity and cost increase significantly

Engineering Contradiction:
Improvefree viewpoint image generation capabilityVSAvoidnumber of image capturing apparatuses
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the essential calibration function from complex multi-camera systems and implements it through a simple circular marker placed on the imaging surface. This allows a single image capturing apparatus to achieve the calibration效果 that previously required multiple apparatuses, significantly reducing device complexity while maintaining free viewpoint image generation capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The circular marker serves as an intermediary object that enables calibration and parameter estimation between the image capturing apparatus and the imaging surface. This simple intermediary replaces the need for complex multi-apparatus arrangements, providing the necessary reference information for generating free viewpoint images with a single camera.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If projection transform is performed to make the elliptical figure appear as an exact circle, then the marker can be accurately specified, but additional processing steps are required

Engineering Contradiction:
Improvemarker detection accuracyVSAvoidimage processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of transforming the image to make the elliptical figure appear as a circle through complex projection transforms, the patent inverts the approach by placing a circular marker directly on the imaging surface. This eliminates the need for complex projection transform processing while achieving accurate marker detection and specification.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent changes the marker parameter from an elliptical figure requiring projection transform to a circular figure that can be directly detected. This parameter change eliminates the need for additional processing steps while maintaining or improving measurement precision for marker specification.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10176590B2Image processing apparatus, image processing method, and non-transitory computer readable storage medium
Publication Date: 2019.01.08 YAHOO JAPAN CORP
  • US10176590B2 patent drawing
  • US10176590B2 patent drawing
  • US10176590B2 patent drawing

AI summary

An image processing apparatus according to the present application includes a reception unit and a specification unit. The reception unit receives image data produced through image capturing by a predetermined image capturing apparatus and including an elliptical figure. The specification unit performs projection transform of the image data so that the elliptical figure included in the image data received by the reception unit appears to be an exact circle, and specifies, based on characteristic information on the exact circle obtained through the projection transform, the exact circle to be a marker used in predetermined processing on the image data.