3D Shape Data Generation Using Unnecessary Space Masking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing visual hull method for generating three-dimensional shape data includes unnecessary spaces, leading to increased calculation complexity and unintended data generation.

Innovation Solution

An image processing apparatus that identifies and deletes unnecessary spaces from the generation space, using unnecessary area mask images and image capturing parameters to generate three-dimensional shape data only in the necessary space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If the generation space is defined by a simple space (rectangular parallelepiped or tetrahedron), then the ease of manufacture is improved, but the amount of calculation increases due to inclusion of unnecessary space

Engineering Contradiction:
Improveease of defining generation spaceVSAvoidcalculation efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent extracts and removes unnecessary spaces from the generation space by using a mask image to define a precise boundary. The mask image identifies regions where no imaging apparatus exists, and these regions are excluded from the generation space, thereby eliminating redundant calculations while maintaining the simplicity of the overall method.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies local quality by differentiating between necessary and unnecessary spaces within the generation space. Using the mask image, the system selectively processes only the necessary regions where imaging apparatuses are present, while ignoring or excluding the unnecessary regions, thus optimizing calculation efficiency without compromising the overall generation space definition.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If the generation space includes unnecessary space, then the adaptability is improved, but the amount of calculation increases

Engineering Contradiction:
Improveadaptability of generation spaceVSAvoidcalculation efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent applies preliminary action by pre-processing the mask image to identify and mark unnecessary spaces before the main calculation process. This preliminary identification allows the system to exclude these regions from subsequent calculations, thereby maintaining adaptability while improving calculation efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The mask image serves as an intermediary element between the generation space definition and the calculation process. It mediates by providing a clear boundary that separates necessary and unnecessary regions, allowing the system to adapt to various scenarios while avoiding redundant calculations in unnecessary spaces.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If the visual hull method is applied to unnecessary space, then the manufacturing precision is improved, but unintended data is generated

Engineering Contradiction:
Improveprecision of three-dimensional shape dataVSAvoidunintended data generation
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent extracts and removes unnecessary spaces from the generation space using the mask image. By excluding regions where no imaging apparatus exists, the system prevents the visual hull method from generating unintended data in these areas, while still maintaining precision in the necessary regions where actual imaging data is available.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent converts the potential harm of including unnecessary spaces into a benefit by using the mask image to precisely identify and exclude these regions. This transformation allows the system to maintain manufacturing precision by focusing calculations only on necessary regions, thereby eliminating unintended data generation while preserving the accuracy of three-dimensional shape data.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS20240169552A1Image processing apparatus, image processing method, and storage medium
Publication Date: 2024.05.23 CANON KK
  • US20240169552A1 patent drawing
  • US20240169552A1 patent drawing
  • US20240169552A1 patent drawing

AI summary

The image processing apparatus generating three-dimensional shape data corresponding to a foreground object for which synchronous image capturing is performed by a plurality of imaging apparatuses according to the present disclosure identifies an unnecessary space, which is a space unnecessary in a case where three-dimensional shape data is generated, from a first generation space in a virtual space corresponding to an image capturing-target space, generates information indicating a second generation space after the unnecessary space is deleted by deleting the identified unnecessary space from the first generation space, and generates the three-dimensional shape data corresponding to the foreground object in the second generation space based on image capturing parameters of an imaging apparatus, which is at least part of the plurality of imaging apparatuses, a captured image obtained by image capturing by the part of the imaging apparatuses, and information indicating the second generation space.