Stereoscopic Panorama Image Synthesis Using Multi-Camera Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing devices cannot generate or display stereoscopic panorama images, lacking the capability to synthesize and present three-dimensional panoramic views effectively.

Innovation Solution

An image generation method that acquires and synthesizes panorama images from multiple cameras positioned in a real space to create left-eye and right-eye images, allowing for a wide field of view and stereoscopic display by dividing and selecting images based on capturing directions, thereby eliminating dead angles and optimizing stereoscopic display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If panorama images are captured by three or more panorama cameras positioned at polygon apexes, then the field of view coverage is improved and dead angles are eliminated, but the device complexity increases

Engineering Contradiction:
Improvefield of view coverageVSAvoiddevice complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The panorama image capture area is segmented into multiple regions, with each region captured by a dedicated panorama camera positioned at a polygon apex. This segmentation allows comprehensive coverage of the entire area without dead angles while maintaining a structured and manageable system architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple panorama images captured by different cameras are merged through image synthesis processing to create a complete stereoscopic panorama image. This combining approach achieves full area coverage and eliminates dead angles that would exist with a single camera system.

Inventive Principle:
Principle #5Merging (Combining)

2Manufacturing precision

If panorama images are divided and synthesized according to image-capturing directions, then the stereoscopic image quality is improved, but the processing time increases

Engineering Contradiction:
Improvestereoscopic image qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Panorama images are pre-divided into multiple regions according to their capturing directions before synthesis. This preliminary segmentation allows the image processing system to efficiently select and combine only the necessary image portions, improving stereoscopic quality while optimizing processing time by avoiding unnecessary computations.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If multiple panorama cameras are used to capture images from different positions, then the stereoscopic effect is improved, but the system complexity increases

Engineering Contradiction:
Improvestereoscopic effectVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system transitions from a single-camera viewpoint to multi-dimensional spatial positioning by placing cameras at polygon apexes. This dimensional expansion creates genuine stereoscopic depth perception while the polygonal arrangement provides a systematic framework that manages complexity through geometric regularity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS9554119B2Image generation method, image display method, storage medium storing image generation program, image generation system, and image display device
Publication Date: 2017.01.24 NINTENDO CO LTD
  • US9554119B2 patent drawing
  • US9554119B2 patent drawing
  • US9554119B2 patent drawing

AI summary

A method for generating a stereoscopic panorama image may include acquiring panorama images respectively captured by three or more panorama cameras located in a real space. A left-eye image and a right-eye image for stereoscopic display may be generated by synthesizing parts of the acquired panorama images. The generated left-eye image and the generated right-eye image may be displayed stereoscopically on a display.