Drone Multi-View Capture for Interactive Digital Media Indexing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current digital media formats, such as 2D images and videos, are inadequate for capturing and reproducing memories with high fidelity and do not support comprehensive search and indexing mechanisms, limiting user interaction and immersive experiences.

Innovation Solution

A drone-based system and method for capturing multi-view interactive digital media representations (MIDMRs) that fuse images with location information to create content and context models, applying enhancement algorithms to generate immersive, interactive 3D-like experiences without rendering actual 3D models, allowing users to interactively view and navigate through the media.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional 2D flat images and videos are used to capture visual data, then the capture process is simple and storage requirements are low, but the user experience is passive and lacks immersion, and search and indexing mechanisms are inadequate

Engineering Contradiction:
Improvecapture process simplicityVSAvoiduser interaction capability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent transitions from traditional 2D flat images and videos to multi-view 3D representations by capturing images from multiple cameras positioned at different spatial locations. This dimensional transformation enables users to interactively navigate and view content from different perspectives, creating an immersive experience while maintaining operational simplicity through automated multi-camera capture systems

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent embeds multiple layers of information within the digital media representation, including 3D spatial data, metadata, location information, and contextual data nested within the multi-view image structure. This nested organization enables comprehensive search and indexing mechanisms while preserving the simplicity of the capture process through structured data integration

Inventive Principle:
Principle #7Nested doll (Nesting)

2Adaptability or versatility

If multi-view 3D representations are created from multiple images, then user interaction and immersion are improved, but computational complexity and storage requirements increase

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidcomputational processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the multi-view capture system into multiple independent camera units, each capturing images from its own perspective. This segmentation allows parallel processing of individual camera feeds and enables distributed computational loads, reducing the complexity burden on any single processing unit while maintaining the immersive multi-view experience

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses multiple cameras to capture identical or similar scenes from different viewpoints, creating redundant copies of the same event or object. These copies are then processed to generate 3D representations, allowing the system to distribute computational work across multiple capture devices and reduce the processing burden on individual units

Inventive Principle:
Principle #26Copying

3Reliability

If multiple images with overlapping subject matter are captured to create multi-view representations, then immersive experience and memory fidelity are improved, but storage requirements and data processing loads increase

Engineering Contradiction:
Improvememory reproduction fidelityVSAvoiddata storage volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent merges multiple images with overlapping subject matter into a unified multi-view 3D representation. By combining and integrating the overlapping content from multiple cameras, the system creates a comprehensive spatial model that preserves memory fidelity while eliminating redundant data storage, as the merged representation contains all necessary information in an optimized format

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11956412B2Drone based capture of multi-view interactive digital media
Publication Date: 2024.04.09 FUSION INC
  • US11956412B2 patent drawing
  • US11956412B2 patent drawing
  • US11956412B2 patent drawing

AI summary

Various embodiments of the present disclosure relate generally to systems and methods for drone-based systems and methods for capturing a multi-media representation of an entity. In some embodiments, the multi-media representation is digital, or multi-view, or interactive, and/or the combinations thereof. According to particular embodiments, a drone having a camera is controlled or operated to obtain a plurality of images having location information. The plurality of images, including at least a portion of overlapping subject matter, are fused to form multi-view interactive digital media representations.