Multi-Camera Control Apparatus for Virtual-Viewpoint Image Focus

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for generating virtual-viewpoint images using multiple cameras often result in compromised image quality due to a small common in-focus range among cameras, leading to large areas not included in the in-focus region.

Innovation Solution

A control apparatus that adjusts the in-focus position of each camera to ensure the distance from the camera to its in-focus point is shorter than to the point closest to other cameras' optical axes, thereby enlarging the common in-focus area and improving image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple cameras are installed at different positions to capture images from multiple directions, then a virtual-viewpoint image can be generated, but the common part of the in-focus ranges becomes small, compromising image quality

Engineering Contradiction:
Improvevirtual-viewpoint image generation capabilityVSAvoidimage quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent changes the focus parameter of each camera dynamically. Specifically, it adjusts the in-focus position of each camera to be closer to the camera body than the intersection point of optical axes, thereby enlarging the common in-focus range and improving image quality in the virtual-viewpoint image.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the in-focus position of each camera is set at the intersection point of optical axes, then the point of interest is in focus, but the common in-focus area is limited to areas far from the cameras

Engineering Contradiction:
Improvefocus accuracy at point of interestVSAvoidcommon in-focus area
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent extends the in-focus area from a limited region near the optical axis intersection to a broader common in-focus range by adjusting focus positions. This creates an expanded three-dimensional in-focus volume that encompasses both the intersection point and areas closer to the cameras, effectively utilizing spatial dimensions to resolve the contradiction.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively enlarges the common in-focus range of multiple cameras, enabling the generation of high-quality virtual-viewpoint images by ensuring that the point of interest is within the in-focus area of all cameras, thus enhancing image capture quality.

Implementation Method 1

a control unit configured to control on the basis of the image capture parameter obtained by the obtaining unit, an in-focus position, on an optical axis, of a target image capturing apparatus

Methodology Applied
Scientific EffectFocusing: Focusing

Data Source

PatentUS11343425B2Control apparatus, control method, and storage medium
Publication Date: 2022.05.24 CANON KK
  • US11343425B2 patent drawing
  • US11343425B2 patent drawing
  • US11343425B2 patent drawing

AI summary

A control apparatus 220 controls the in-focus positions of a plurality of image capturing apparatuses that perform image capturing from a plurality of directions in order to generate a virtual-viewpoint image. Specifically, the control apparatus 220 obtains an image capture parameter related to image capturing by one or more image capturing apparatuses included in an image capturing apparatus group 100. The control apparatus 220 controls on the basis of the obtained image capture parameter, the in-focus position of a target image capturing apparatus corresponding to the image capture parameter such that the distance from the target image capturing apparatus to the in-focus position of the target image capturing apparatus is shorter than the distance from the target image capturing apparatus to a point of interest.