Mobile Image Acquisition Using 3D Orientation Guidance Indoors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in effectively capturing and displaying visual information within building interiors without specialized equipment, and in controlling the display of such information in a user-selected manner for remote viewing.

Innovation Solution

Utilizing a handheld mobile device equipped with sensors to automatically control image acquisition by determining its geometric orientation in 3D space, generating panorama images, and displaying a GUI that guides the user to acquire images at defined orientations, which are then used to generate mapping information for the building.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If manual image acquisition methods are used without specialized equipment, then device complexity is reduced, but image acquisition accuracy and completeness deteriorate

Engineering Contradiction:
Improveequipment requirementVSAvoidimage acquisition accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent makes a standard mobile device perform multiple functions: it uses the device's existing camera for image capture, sensors (accelerometer, gyroscope, magnetometer) for orientation detection, and GPS for location tracking. This multi-functional approach eliminates the need for specialized equipment while maintaining acquisition accuracy through automated sensor-based control.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The mobile device automatically determines its own geometric orientation in 3D space using its built-in sensors without requiring external specialized equipment. The device self-corrects for orientation changes, automatically controlling the image acquisition process based on sensor data, thereby achieving accurate panoramic images without manual intervention or specialized tools.

Inventive Principle:
Principle #25Self-service

2Productivity

If automated sensor-based control is implemented, then image acquisition efficiency is improved, but device complexity increases

Engineering Contradiction:
Improveimage acquisition efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent combines multiple existing mobile device components (camera, accelerometers, gyroscopes, magnetometers, GPS) into an integrated automated image acquisition system. By merging these existing functions and coordinating them through software, the system achieves high acquisition efficiency without adding physical complexity, as all components already exist in modern smartphones.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system continuously monitors sensor data from the mobile device to detect orientation changes and automatically adjusts image acquisition parameters accordingly. This real-time feedback loop enables automated control that improves efficiency by capturing images at optimal moments without requiring complex manual coordination or additional hardware.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If multiple images are acquired for panorama generation, then mapping information quality is improved, but time consumption increases

Engineering Contradiction:
Improvemapping information qualityVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system automatically captures multiple images at periodic intervals as the mobile device moves through the environment. By using sensor data to trigger periodic image acquisition, the system ensures sufficient overlapping images for high-quality panorama and mapping generation while minimizing total capture time through automated timing rather than manual operation.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system pre-determines the optimal number and positions of images needed for quality mapping by analyzing sensor data and environment characteristics before acquisition begins. This preliminary planning allows the system to capture exactly the right number of images for high-quality results without excessive time consumption, avoiding both under-capture and redundant over-capture.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3864490B1Automated control of image acquisition via use of acquisition device sensors
Publication Date: 2026.04.15 ZILLOW INC
  • EP3864490B1 patent drawingFigure 1A~1B
  • EP3864490B1 patent drawingFigure 1C~1D
  • EP3864490B1 patent drawingFigure 2A

AI summary

Techniques are described for using computing devices to perform automated operations to control acquisition of images in a defined area, including obtaining and using data from one or more hardware sensors on a mobile device that is acquiring the images, analyzing the sensor data (e.g., in a real-time manner) to determine the geometric orientation of the mobile device in three-dimensional (3D) space, and using that determined orientation to control the acquisition of further images by the mobile device. In some situations, the determined orientation information may be used in part to automatically generate and display a corresponding GUI (graphical user interface) that is overlaid on and augments displayed images of the environment surrounding the mobile device during the image acquisition process, so as to control the mobile device's geometric orientation in 3D space.