Image Synthesis Subject Region Determination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mixed reality technologies face challenges in rapidly and accurately determining a subject region in real-time, particularly in video see-through systems, due to the need for multiple image captures and manual registration of color information, which increases preparation time and requires expertise, making it difficult to provide an immersive experience in time-pressured situations.

Innovation Solution

An information processing apparatus that generates a synthesized image using an extraction image and an instruction image to acquire subject color information, allowing for rapid determination of the subject region by acquiring color information from a single image and utilizing background color information from adjacent regions, enabling efficient subject extraction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple images are captured from different viewpoints to extract subject region, then the accuracy of subject region determination is improved, but the preparation time increases

Engineering Contradiction:
Improvesubject region determination accuracyVSAvoidpreparation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts only the necessary color information from a single captured image by defining a subject region in advance. Instead of capturing multiple images from different viewpoints, the system extracts color information specifically from the predetermined subject region and its adjacent background region, achieving accurate subject region determination while significantly reducing preparation time

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies preliminary action by defining the subject region in advance before image capture. The subject region definition unit pre-defines which region contains the subject, so that when the image is captured, color information can be immediately extracted from the correct region without needing multiple captures or post-processing analysis

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If manual registration of color information is performed to separate subject and background regions, then the subject region determination accuracy is improved, but the ease of operation deteriorates

Engineering Contradiction:
Improvesubject region determination accuracyVSAvoidease of color information registration
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs self-service by automatically determining the subject region based on pre-defined subject region information and automatically extracting color information from the captured image. The determination unit uses the pre-defined subject region definition to automatically identify and extract color information without requiring manual operator intervention, making the system easy to operate while maintaining high accuracy

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent introduces an intermediary element - the pre-defined subject region definition - that acts as a mediator between the captured image and the color information extraction process. This definition serves as a template or guide that enables automatic, accurate extraction without manual registration, bridging the gap between raw image data and meaningful subject identification

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9679415B2Image synthesis method and image synthesis apparatus
Publication Date: 2017.06.13 CANON KK
  • US9679415B2 patent drawing
  • US9679415B2 patent drawing
  • US9679415B2 patent drawing

AI summary

In order to easily and rapidly determine a subject region in a captured image using a single image, a synthesized image of an extraction image including a subject and an instruction image representing a first acquisition region from which color information on the subject is acquired is used. Color information on the subject is acquired from the first acquisition region represented by the instruction image in the synthesized image. Color information on a background of the subject is acquired from a region not including the first acquisition region and a color information non-acquisition region that is adjacent to the first acquisition region and is set in advance in the synthesized image. On the basis of the color information on the subject and the color information on the background, extraction information of the subject is determined and output.