Scene Reconstruction from Image Bursts Using Key Frame Anchors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for scene reconstruction from image data are time-consuming and resource-intensive, especially when capturing data from few positions, as they struggle to identify common image features and anchor points, leading to difficulties in generating accurate reconstructions.

Innovation Solution

The system captures bursts of image data from multiple positions, identifies key frames, and uses common image features and anchor points to determine image capture device positions, allowing for the generation of high-quality scene reconstructions without the need for extensive data capture, by processing each burst and combining them into a unified reconstruction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If image data is captured from many diverse positions to improve reconstruction quality, then manufacturing precision of scene reconstruction is improved, but loss of time and use of energy increase

Engineering Contradiction:
Improvescene reconstruction qualityVSAvoiddata capture time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent segments the continuous image capture process into discrete bursts captured at specific key positions. Instead of continuously capturing images while moving through the scene, the system captures concentrated bursts of images at selected positions, then uses structure-from-motion algorithms to reconstruct the scene from these segmented datasets, significantly reducing total capture time while maintaining reconstruction quality

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary planning to identify key positions and capture bursts before actual scene reconstruction. By pre-determining optimal capture positions and capturing complete bursts at each position beforehand, the system eliminates the need for continuous capture during movement, reducing time loss while ensuring sufficient data for high-quality reconstruction

Inventive Principle:
Principle #10Preliminary action

2Loss of time

If image data is captured from too few positions to reduce time and resources, then loss of time and use of energy are reduced, but manufacturing precision of scene reconstruction deteriorates

Engineering Contradiction:
Improvedata capture timeVSAvoidscene reconstruction quality
Core Design Contradiction:
Loss of timeVSManufacturing precision

Solution Approach 1:

The patent applies partial action by capturing image bursts only at selected key positions rather than continuously throughout the entire scene. This partial capture approach focuses computational and capture resources on critical positions that provide maximum geometric information, achieving sufficient reconstruction quality with fewer capture positions and reduced time

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system changes the parameter of capture density from uniform continuous capture to concentrated burst capture at discrete positions. By transforming the capture strategy from distributed low-density sampling to concentrated high-density bursts at key positions, the system maintains reconstruction precision while reducing total capture time and resources

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If continuous image capture is performed while moving through the scene to improve reconstruction completeness, then manufacturing precision is improved, but use of energy and loss of time increase

Engineering Contradiction:
Improvescene reconstruction completenessVSAvoidimage capture device energy consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by capturing images in discrete bursts at specific positions rather than continuously during movement. The image capture device moves through the scene without continuous capture, then periodically captures bursts at predetermined positions, reducing energy consumption while maintaining sufficient data for complete scene reconstruction through structured processing of these periodic bursts

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS10535156B2Scene reconstruction from bursts of image data
Publication Date: 2020.01.14 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10535156B2 patent drawing
  • US10535156B2 patent drawing
  • US10535156B2 patent drawing

AI summary

Examples of the present disclosure describe systems and methods for scene reconstruction from bursts of image data. In an example, an image capture device may gather information from multiple positions within the scene. At each position, a burst of image data may be captured, such that other images within the burst may be used to identify common image features, anchor points, and geometry, in order to generate a scene reconstruction as observed from the position. Thus, as a result of capturing bursts from multiple positions in a scene, multiple burst reconstructions may be generated. Each burst may be oriented within the scene by identifying a key frame for each burst and using common image features and anchor points among the key frames to determine a camera position for each key frame. The burst reconstructions may then be combined into a unified reconstruction, thereby generating a high-quality reconstruction of the scene.