Panoramic Image Depth Extraction via Cubemap Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for obtaining depth information of panoramic images are ineffective in outdoor environments, making it difficult to achieve accurate depth data across various settings, including both indoor and outdoor environments.

Innovation Solution

A processing device and method that converts panoramic images from an initial format to a cubemap format, duplicates and connects view angle blocks, calculates depth information, performs blending processes, and stitches depth information blocks to generate a depth information image in cubemap format, which is then converted back to the original format, enabling the extraction of reliable depth data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If current depth information obtaining methods are used, then indoor environment depth data can be obtained, but outdoor environment depth data cannot be obtained

Engineering Contradiction:
Improveenvironmental adaptabilityVSAvoiddepth information reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The panoramic image is divided into multiple cubemap blocks (first cubemap block, second cubemap block, third cubemap block) that are processed separately. Each block undergoes independent depth calculation and blending, allowing the method to handle different environmental conditions in different regions of the panoramic image, thereby achieving both indoor and outdoor environmental adaptability while maintaining depth information reliability.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If panoramic image is converted to cubemap format and processed through multiple blending operations, then accurate depth information can be generated, but processing complexity increases

Engineering Contradiction:
Improvedepth information accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The processing is segmented into distinct stages: converting panoramic image to cubemap format, dividing into multiple blocks, calculating depth for each block, performing blending operations on overlapping regions, and stitching blocks together. This segmentation allows complex processing to be broken down into manageable steps, improving depth accuracy while making the complexity systematic and controllable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The panoramic image is pre-converted to cubemap format and divided into blocks before depth calculation begins. This preliminary organization of data structure prepares the image for efficient processing, allowing subsequent depth calculations and blending operations to proceed systematically, thereby achieving high precision without unnecessary complexity during the actual depth extraction phase.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11734795B2Image processing method and device for panoramic image
Publication Date: 2023.08.22 IND TECH RES INST
  • US11734795B2 patent drawing
  • US11734795B2 patent drawing
  • US11734795B2 patent drawing

AI summary

A processing device and method for a panoramic image includes converting the panoramic image to a cubemap format; under the cubemap format, calculating a depth information image of the panoramic image, and performing a seamless processing on the depth information image. The format of the depth information image is converted to the original format from the cubemap format to obtain the depth information image corresponding to the panoramic image.