Virtual Viewpoint Image Generation Method Selection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for generating virtual viewpoint images lack an appropriate determination method for selecting the optimal generation method based on the situation, leading to potential inaccuracies in image quality due to variations in the number of cameras used.

Innovation Solution

An information processing apparatus that determines the appropriate generation method for virtual viewpoint images based on the imaging situation using multiple cameras, incorporating a determination unit to select from various methods and an output unit to process the determined results.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a fixed generation method is used for virtual viewpoint images, then the processing flow is simple, but the image quality and accuracy deteriorate when the number of cameras varies

Engineering Contradiction:

Improveprocessing flow complexityVSAvoidimage generation accuracy

Core Design Contradiction:

Device complexityVSManufacturing precision

Solution Approach 1:

The patent implements dynamic selection of generation methods based on the number of cameras available. The determination unit dynamically switches between first generation method (for 2 or more cameras) and second generation method (for single camera), allowing the system to adapt to varying camera configurations and maintain optimal image generation accuracy under different conditions

Inventive Principle:

Principle #15Dynamics

2Device complexity

If the number of cameras is reduced, then the device complexity and cost are lowered, but the model generation accuracy deteriorates

Engineering Contradiction:

Improvenumber of camerasVSAvoidmodel generation accuracy

Core Design Contradiction:

Device complexityVSMeasurement precision

Solution Approach 1:

The patent changes the generation parameters and processing flow based on the number of cameras. When a single camera is used, the system switches to a different generation method that adapts to the limited data availability, adjusting the parameter selection and processing steps to maintain acceptable accuracy despite the reduced number of input images

Inventive Principle:

Principle #35Parameter changes

3Ease of operation

If a single generation method is used for all situations, then the system is easier to operate, but the adaptability to different imaging situations deteriorates

Engineering Contradiction:

Improvesystem operation simplicityVSAvoidadaptability to imaging situations

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The determination unit automatically selects the appropriate generation method based on the number of cameras without requiring manual user intervention. The system self-adapts to different imaging situations by automatically switching between generation methods, maintaining ease of operation while achieving high adaptability

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS11012674B2Information processing apparatus, image generation method, control method, and program

Publication Date: 2021.05.18 CANON KK

AI summary

An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.