AR Enhanced Models for Accurate Large-Object Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality systems face challenges in accurately displaying information on large objects due to decreased accuracy at distances greater than five meters and the need for numerous anchors, which is resource-intensive and difficult to achieve, especially for objects like aircraft or buildings.

Innovation Solution

An augmented reality system utilizing a group of unmanned aerial vehicles to generate images and scan data, creating an enhanced model of the physical object with greater detail in specific regions, allowing for improved localization and information display on portable computing devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the distance of the augmented reality device from the anchor increases, then the coverage area increases, but the accuracy of displaying augmented reality information decreases

Engineering Contradiction:
Improvecoverage areaVSAvoiddisplay accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent divides the large physical object into multiple regions, each with its own set of anchors. Instead of using one global coordinate system, the system segments the object into manageable portions (e.g., wing sections, fuselage sections) and creates localized models for each segment. This allows accurate tracking within each segment even when the device is at varying distances, resolving the contradiction between coverage area and display accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements local quality by creating enhanced models with higher detail for specific regions of interest. Each region has its own optimized anchor configuration and model fidelity, allowing the system to maintain high accuracy for displayed information in each local area while covering a large overall area. The system adjusts model detail and anchor density based on the specific requirements of each region.

Inventive Principle:
Principle #3Local quality

2Area of stationary object

If the size of the physical object increases, then the information coverage increases, but the number of anchors needed increases making the system more complex and resource-intensive

Engineering Contradiction:
Improveinformation coverageVSAvoidnumber of anchors
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent segments the large physical object into multiple smaller regions, each with its own subset of anchors. This segmentation allows the system to cover large areas by distributing anchors across multiple regions rather than requiring all anchors to be simultaneously visible. Each region can be independently tracked with fewer anchors, reducing the complexity burden on any single device while maintaining comprehensive coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces temporal dimension to the anchor system by allowing anchors to be activated and deactivated based on the current region of interest. Instead of requiring all anchors to be permanently active and visible, the system dynamically switches between different anchor sets corresponding to different regions, effectively using time as an additional dimension to manage anchor complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If the detail level of the model for the entire physical object is increased, then the localization accuracy improves, but the processing resources required increase

Engineering Contradiction:
Improvelocalization accuracyVSAvoidprocessing resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by creating enhanced models with high detail only for specific regions of interest rather than uniformly high detail across the entire object. Each region has its own enhanced model with appropriate detail level, allowing the system to achieve high localization accuracy for the current region while keeping overall processing requirements manageable by not maintaining high-detail models for all regions simultaneously.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by loading and processing only the portion of the model that is currently relevant to the user's view and interaction. Instead of processing and maintaining the entire high-detail model in memory, the system loads only the necessary regional models, processes them in detail, and keeps other regions in a lower-detail or unloaded state, thereby reducing processing resource consumption while maintaining accuracy where needed.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11030812B2Augmented reality system using enhanced models
Publication Date: 2021.06.08 THE BOEING CO
  • US11030812B2 patent drawing
  • US11030812B2 patent drawing
  • US11030812B2 patent drawing

AI summary

A method, apparatus, and system for visualizing information. An augmented reality system comprises a computer system and a visualizer in the computer system. The computer system is in communication with unmanned vehicles using communications links. The visualizer system receives images of a physical object from the unmanned vehicles moving relative to the physical object and receive scan data for a region of the physical object from the unmanned vehicles. The visualizer creates an enhanced model of the physical object using the images and the scan data. The region of the physical object in the enhanced model has a greater amount of detail than the other regions of the physical object. The visualizer sends information to a portable computing device that is displayable by the portable computing device on a live view of the physical object. The information is identified using the enhanced model of the physical object.