Virtual Viewpoint Imaging Focus Point Determination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for generating virtual viewpoint images from multiple imaging apparatuses struggle with maintaining image quality when the shared focus range is small, making it difficult to visually verify the focus position of each imaging apparatus.

Innovation Solution

An information processing apparatus that determines and sets a focus point closer to each imaging apparatus than the observation point, extending the focus region and allowing users to visually check the focus state through a user interface, thereby improving image quality and focus verification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the focus position of each imaging apparatus is adjusted to extend the focus region, then the region for virtual viewpoint image generation is extended, but the focus position exists in the air and cannot be visually checked

Engineering Contradiction:
Improvefocus regionVSAvoidfocus position verification
Core Design Contradiction:
Area of stationary objectVSDifficulty of detecting and measuring

Solution Approach 1:

A marker is introduced as an intermediary object to represent the focus position. The marker is placed at a position that corresponds to the calculated focus position on the object surface, allowing visual verification of focus status without requiring the focus position to exist physically in air. The marker serves as a mediator between the abstract focus position and visual confirmation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Instead of directly verifying the focus position in three-dimensional space, the system creates a two-dimensional representation (marker) on the object surface that copies the spatial information of the focus position. This allows the focus state to be visually checked through the marker's position and appearance in captured images.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If the shared portion of focus ranges of imaging apparatuses is small, then imaging apparatuses can be installed at different positions, but the region not included in shared portion becomes large and image quality lowers

Engineering Contradiction:
Improveimaging apparatus installation flexibilityVSAvoidimage quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system allows each imaging apparatus to have its focus position independently optimized for local regions rather than requiring all apparatuses to share a common focus range. By calculating and setting individual focus positions based on each apparatus's specific imaging characteristics and intended capture region, the system maintains image quality in each local area while allowing flexible installation positions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The focus position parameter is dynamically adjusted for each imaging apparatus based on calculated optimal values rather than using a fixed shared focus range. This parameter change allows each apparatus to operate at its optimal focus setting, extending the overall effective focus region while maintaining image quality, thereby enabling greater installation flexibility.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11172188B2Information processing apparatus, information processing method, and storage medium
Publication Date: 2021.11.09 CANON KK
  • US11172188B2 patent drawing
  • US11172188B2 patent drawing
  • US11172188B2 patent drawing

AI summary

An information processing apparatus determines a position on an object, based on a distance between a set position and an imaging apparatus configured to capture an image of a predetermined position on an object and be used for generating a virtual viewpoint image, the set position being located on a line segment connecting the imaging apparatus and the predetermined position, and being a position of a focus point closer than the predetermined position when viewed from the imaging apparatus, and sets, for a plurality of imaging apparatuses, the determined position as a focus point of the imaging apparatus.