Indoor Panorama Localization Without Depth Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods face challenges in accurately determining the acquisition location of images within building interiors without the use of depth sensors or distance-measuring devices, and in effectively representing and utilizing building interior information for navigation and visualization.
Innovation Solution
The system automatically determines the acquisition location of images by analyzing their contents, using image angular descriptors to match with building angular descriptors, and integrates this information with floor plans for improved navigation and visualization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If traditional floor plans are used to represent building interiors, then layout information can be provided, but they are difficult to construct, maintain, accurately scale, and visualize
Solution Approach 1:
The patent uses images captured by cameras to create visual copies of building interiors, replacing traditional floor plans. These images are processed and annotated to extract spatial information, providing an easier way to represent and update building layouts without manual construction and maintenance of floor plans
Solution Approach 2:
The patent replaces the mechanical process of manually creating and maintaining floor plans with an automated image-based system. Computer vision algorithms and machine learning models automatically process images to extract spatial relationships, eliminating the need for manual floor plan construction and updates
2Measurement precision
If depth sensors or distance-measuring devices are used to determine image acquisition locations, then location accuracy can be improved, but device complexity and cost increase
Solution Approach 1:
The patent replaces depth sensors and distance-measuring devices with a computer vision-based system that uses standard cameras. The system estimates acquisition locations by analyzing visual features in images and comparing them with floor plan data, eliminating the need for specialized sensing equipment
Solution Approach 2:
The patent introduces floor plan images as an intermediary reference to bridge the gap between standard camera images and spatial location information. By comparing visual features in captured images with the known geometry in floor plans, the system indirectly determines acquisition locations without direct distance measurement
3Loss of information
If manual methods are used to capture and represent building interior information, then detailed visual information can be obtained, but the process is time-consuming and difficult to use for navigation
Solution Approach 1:
The patent enables continuous automatic processing of images as they are captured, with real-time or near-real-time extraction of spatial information. The system continuously updates the understanding of building interiors and navigation paths without interruption, eliminating manual processing delays
Solution Approach 2:
The patent implements automated processing where the system itself performs image analysis, feature extraction, and spatial relationship determination without human intervention. The computer vision algorithms automatically interpret images and generate navigation information, making the system self-sufficient
Data Source
AI summary
Techniques are described for using computing devices to perform automated operations for determining the acquisition location of an image using an analysis of the image's visual contents. In at least some situations, images to be analyzed include panorama images acquired at acquisition locations in an interior of a multi-room building, and the determined acquisition location information includes a location on a floor plan of the building and in some cases orientation direction information—in at least some such situations, the acquisition location determination is performed without having or using information from any distance-measuring devices about distances from an image's acquisition location to objects in the surrounding building. The acquisition location information may be used in various automated manners, including for controlling navigation of devices (e.g., autonomous vehicles), for display on one or more client devices in corresponding graphical user interfaces, etc.