Binocular Stereo Panoramic Image Generation via Direct Pixel Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for obtaining binocular panoramic images are inefficient and result in low-quality images due to the need for extensive image stitching, which requires multiple image sources and a long processing time, often leading to image distortion.

Innovation Solution

The method involves using two horizontally disposed panoramic cameras to acquire and match pixels between images, calculating depth information based on pixel distances, and mapping these images to create a binocular stereo panoramic image without the need for image unfolding or stitching, utilizing a preset pupil distance to simulate the human eye's perspective.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional image stitching method is used to obtain binocular panoramic images, then the process can generate panoramic images, but it requires a large number of image sources and takes a long time to stitch, resulting in low efficiency

Engineering Contradiction:
Improveefficiency of obtaining panoramic imageVSAvoidstitching time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent extracts and utilizes the depth information directly from the two input panoramic images through pixel matching, eliminating the need for time-consuming traditional stitching processes. By focusing on extracting corresponding pixels and calculating depth based on their positions, the system achieves fast binocular panoramic image generation without requiring multiple image sources or extensive stitching operations.

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If traditional image stitching method is used, then panoramic images can be generated, but repeated stitching and image damage or distortion would occur, resulting in low quantity of image obtained

Engineering Contradiction:
Improveimage qualityVSAvoidimage distortion
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The patent converts the harmful effect of traditional stitching distortion into a benefit by using a direct pixel-matching approach. Instead of stitching multiple images which causes distortion, the system uses the two input panoramic images directly and calculates depth information based on pixel correspondence, thereby preserving original image quality and eliminating distortion while maintaining binocular stereo vision functionality.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

3Productivity

If traditional image stitching method is used, then panoramic images can be generated, but it requires a large number of image sources, causing low efficiency

Engineering Contradiction:
Improveefficiency of obtaining panoramic imageVSAvoidnumber of image sources
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent makes the two input panoramic images serve multiple functions simultaneously: they act as both the left and right eye images for binocular stereo vision and also provide the depth information through pixel matching. This multi-functionality eliminates the need for additional image sources required by traditional stitching methods, thereby improving efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11632537B2Method and apparatus for obtaining binocular panoramic image, and storage medium
Publication Date: 2023.04.18 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US11632537B2 patent drawing
  • US11632537B2 patent drawing
  • US11632537B2 patent drawing

AI summary

A method for obtaining a binocular panoramic image is performed at an electronic apparatus, including: obtaining first and second panoramic images acquired by two panoramic cameras; obtaining at least one group of a first pixel located in the first panoramic image and a second pixel located in the second panoramic image; calculating a distance between the first pixel and the second pixel in each group, and obtaining depth information corresponding to the two panoramic image according to the distance between the first pixel and the second pixel; converting the first panoramic image and the second panoramic image into a first monocular panoramic image and a second monocular panoramic image, respectively in accordance with the corresponding depth information and a preset pupil distance between a first eye and a second eye; and combining a display of the first monocular panoramic image and the second monocular panoramic image in corresponding display regions.