Mobile Device Interior Capture Using Linked Panoramas

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods fail to accurately and efficiently capture immersive visual information of building interiors without requiring extensive time and specialized equipment, limiting the ability to understand layouts and details from traditional photographs.

Innovation Solution

A system using mobile devices to capture video data from multiple viewing locations within a building, incorporating inertial measurement unit data to create linked panorama images, allowing for automated analysis and presentation of the interior environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional still photographs are used to capture building interiors, then the operation is simple and equipment is basic, but the ability to understand layout and interior details is insufficient

Engineering Contradiction:
Improveunderstanding of layout and interior detailsVSAvoidequipment requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple camera lenses (e.g., wide-angle, telephoto, macro) into a single mobile device to capture comprehensive visual information of building interiors. This merging of multiple imaging functions into one device allows users to obtain detailed layout and interior understanding without requiring separate specialized equipment for each type of shot.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The mobile device is designed to perform multiple functions: capturing still images, recording video, creating panoramic views, and providing virtual navigation capabilities. This multi-functional approach replaces the need for multiple specialized devices while maintaining comprehensive interior documentation capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If specialized equipment is used to capture immersive visual information, then the quality of interior representation improves, but the device complexity and cost increase

Engineering Contradiction:
Improveimmersive visual information qualityVSAvoidspecialized equipment requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system creates virtual copies and representations of the physical building interior through digital panoramas, 360-degree images, and virtual walkthroughs. These digital replicas provide immersive visual information that replicates the experience of being physically present in the space, eliminating the need for complex specialized capture equipment.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces mechanical specialized equipment (such as tripods, dedicated panorama cameras, and physical measurement tools) with software-based solutions running on mobile devices. Image processing algorithms, virtual reality rendering, and automated panorama stitching replace the need for mechanical stabilization and specialized optical systems.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If extensive time is spent capturing detailed interior information, then the completeness of the representation improves, but the productivity decreases

Engineering Contradiction:
Improvecompleteness of interior representationVSAvoidcapture efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system performs preliminary actions by automatically capturing images at multiple predetermined locations and angles, then processes and stitches these images into comprehensive panoramas without requiring manual intervention at each step. This preliminary automated capture and processing ensures complete interior documentation while minimizing the time the user must spend on the actual capture process.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements continuous capture modes where the mobile device automatically records images, video, and sensor data continuously as the user moves through the space. This continuous action ensures no interior details are missed while eliminating the need for manual setup and adjustment between shots, significantly improving capture efficiency.

Inventive Principle:
Principle #20Continuity of useful action

4Measurement precision

If multiple viewing locations are captured to show complete layout, then the understanding of spatial relationships improves, but the time and complexity of data processing increases

Engineering Contradiction:
Improvespatial relationship understandingVSAvoiddata processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system uses intermediary elements such as visual markers, fiducial markers, or feature point detection as mediators to automatically link images from multiple viewing locations. These intermediaries enable the software to automatically determine spatial relationships and stitch panoramas without requiring complex manual alignment processes, reducing processing time while maintaining accurate spatial representation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent implements dynamic panorama creation where the system continuously processes and updates the spatial representation as new images are captured. The processing is performed incrementally and adaptively, adjusting to the user's movement and capture sequence in real-time, which reduces overall processing time compared to static batch processing of all images.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient and immersive representation of building interiors through linked panorama images, improving understanding of layouts and details without the need for extensive time or specialized equipment.

Implementation Method 1

incorporating inertial measurement unit data to create linked panorama images

Methodology Applied
Scientific EffectInertial measurement: Inertia

Data Source

PatentUS11165959B2Connecting and using building data acquired from mobile devices
Publication Date: 2021.11.02 MFTB HOLDCO INC
  • US11165959B2 patent drawing
  • US11165959B2 patent drawing
  • US11165959B2 patent drawing

AI summary

Techniques are described for automated operations involving acquiring and analyzing information from an interior of a house, building or other structure, for use in generating and providing a representation of that interior. Such techniques may include using a user's mobile device to capture video data from multiple viewing locations (e.g., 360° video at each viewing location) within multiple rooms, and capturing data linking the multiple viewing locations (e.g., by recording video, acceleration and/or other data from the mobile device as the user moves between the two viewing locations), creating a panorama image for each viewing location, analyzing the linking information to model the user's travel path and determine relative positions/directions between at least some viewing locations, creating inter-panorama links in the panoramas to each of one or more other panoramas based on such determined positions/directions, and providing information to display multiple linked panorama images to represent the interior.