Panoramic Image Synthesis Using Multiple Cameras

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing panoramic image generation techniques are limited to generating images with the position of the image capture apparatus as the base point, making it difficult to create panoramic images from locations where the apparatus cannot be easily installed, such as in the middle of a soccer game or other events where interference occurs.

Innovation Solution

An image processing apparatus that obtains images from multiple cameras positioned differently and generates a panoramic image with a specific position in the imaging region as the reference, allowing for the creation of panoramic images from any desired viewpoint within the imaging region.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a single image capture apparatus is used to generate panoramic images, then the apparatus can be easily installed and operated, but the base point is limited to the position of the apparatus itself, reducing flexibility in selecting panoramic image reference positions

Engineering Contradiction:
Improveease of installationVSAvoidflexibility in selecting base point
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system divides the panoramic image generation task into multiple segments by using multiple image capture apparatuses positioned at different locations. Each apparatus captures images from its own position, and these segmented views are then synthesized to create a panoramic image with an arbitrary base point that none of the individual apparatuses occupy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system merges images captured from multiple different positions and directions by multiple image capture apparatuses. Through image synthesis processing, these separate captures are combined to generate a panoramic image with a base point that is a virtual position not occupied by any physical apparatus, thereby achieving both ease of installation and flexibility in base point selection.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If the image capture apparatus is positioned at the desired base point location, then panoramic images can be generated with that location as reference, but the apparatus cannot be installed at locations where interference occurs or access is difficult

Engineering Contradiction:
Improveability to generate panoramic image from any positionVSAvoidease of installation
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The system introduces an intermediary image synthesis processing unit that acts as a mediator between the multiple physical image capture apparatuses and the desired virtual base point. This intermediary processing synthesizes the captured images to create a panoramic view from a position that may not physically exist or be accessible, eliminating the need to install apparatuses in difficult-to-reach locations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates virtual copies of the imaging function at positions where physical apparatuses cannot be installed. By synthesizing images from multiple real apparatuses, the system produces panoramic images that appear to be captured from virtual positions (copies of the imaging function) that are inaccessible to physical devices, thereby achieving the desired adaptability without compromising installation ease.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If multiple image capture apparatuses are used to achieve flexible base point selection, then panoramic images with arbitrary reference positions can be generated, but the system complexity increases

Engineering Contradiction:
Improvefreedom in selecting base pointVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system implements a universal image synthesis processing capability that can generate panoramic images with any desired base point using a standardized set of multiple image capture apparatuses. This multi-functional approach allows the same apparatus configuration to serve multiple purposes and generate panoramic views from various virtual positions, reducing the need for different specialized systems and thereby managing complexity while maintaining high adaptability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11627251B2Image processing apparatus and control method thereof, computer-readable storage medium
Publication Date: 2023.04.11 CANON KK
  • US11627251B2 patent drawing
  • US11627251B2 patent drawing
  • US11627251B2 patent drawing

AI summary

An image processing apparatus comprises an image obtaining unit that obtains a plurality of images based on image capturing performed by a plurality of image capture apparatuses that perform image capturing of an imaging region from directions that are different to each other, and a panoramic image generating unit that generates a panoramic image with a specific position in the imaging region being a reference, based on a plurality of images obtained by the image obtaining unit.