Dynamic 3D Panorama Stitching With Source Image Zoom

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Panoramic images generated by stitching multiple images often result in artifacts and deformities, leading to an inaccurate portrayal of the scene compared to the original images.

Innovation Solution

A method and system that allow users to transition between panoramic images and the original still images from which they were generated, using processors to zoom and pan between them, aligning features to minimize artifacts and convey a sense of 3D depth.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple images are stitched together to create a panoramic image, then the coverage area of the scene is improved, but artifacts and deformities are introduced that reduce image accuracy

Engineering Contradiction:
Improvecoverage areaVSAvoidimage accuracy
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The panoramic image is segmented into multiple source images that can be independently displayed. When a user zooms into a specific region, the system identifies which source image(s) correspond to that region and displays the original unprocessed image data from those sources, thereby avoiding artifacts while maintaining wide coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system creates a mapping between regions of the panoramic image and their corresponding source images. By copying and displaying the original source image data directly in the zoomed-in view, the system eliminates stitching artifacts while preserving the benefits of panoramic coverage.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If original still images are displayed within the panoramic image during zooming, then image accuracy is improved, but the system complexity increases

Engineering Contradiction:
Improveimage accuracyVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system introduces an intermediary layer that maps coordinates between the panoramic image space and the source image space. This intermediary mapping structure enables seamless transitions between panoramic and source image views without requiring complex reprocessing of the original images.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system dynamically switches between displaying the panoramic image and the original source images based on user interaction (zooming). When zoomed in, it displays the corresponding source image; when zoomed out, it displays the panoramic view, optimizing both accuracy and performance.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10469745B1Dynamic 3D panoramas
Publication Date: 2019.11.05 GOOGLE LLC
  • US10469745B1 patent drawing
  • US10469745B1 patent drawing
  • US10469745B1 patent drawing

AI summary

The technology relates to transitioning between panoramic imagery and the imagery from which the panoramic imagery was generated. Individual images of a portion of a scene may be combined to create a panoramic image of the entire scene. The individual images may be associated with the portion of the panoramic image which they form. The full panoramic image may then be displayed. Based on user input, a portion of the panoramic image may be zoomed-in on, and the individual image associated with that portion of the panoramic image may be displayed.