Layered 3D Model Data Structure for Mobile AR Bandwidth Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems on mobile devices face challenges in achieving device-independent, transport-efficient, and process-bandwidth-efficient geo-spatial registration of digital data onto real-world objects, particularly due to limitations in mobile network bandwidth and battery life.

Innovation Solution

A model representing objects at geographic coordinates is stored in a memory device with a data structure of layers, including a wireframe representation and increasing surface detail, along with digital data layers linked to geographic coordinates, allowing for efficient transmission and processing of digital content over wireless communication channels to mobile devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If high-resolution digital data is transmitted to mobile devices for augmented reality, then display quality improves, but network bandwidth consumption increases

Engineering Contradiction:
Improvedisplay qualityVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent segments the 3D model data into multiple layers of increasing detail (LOD layers). Instead of transmitting complete high-resolution models, the system transmits only the necessary layer based on viewing distance and device capabilities, achieving a balance between display quality and bandwidth consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by providing high-detail models only for regions of interest or close-viewing areas, while using lower-detail representations for distant or less important areas. This allows the system to optimize bandwidth usage while maintaining display quality where it matters most.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If complex processing is performed on mobile devices for augmented reality, then registration accuracy improves, but battery life decreases

Engineering Contradiction:
Improveregistration accuracyVSAvoidbattery life
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent divides the processing workload into segments: complex tasks like initial model creation and detailed rendering are performed on powerful remote servers, while mobile devices handle only lightweight tasks such as displaying pre-processed layers and simple user interactions. This segmentation maintains registration accuracy while preserving battery life.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary server system that acts as a mediator between the complex processing requirements and mobile device limitations. The server performs heavy computational tasks and prepares optimized data layers, which are then transmitted to mobile devices for display, reducing the energy burden on mobile devices while maintaining accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If detailed 3D models are stored and transmitted, then geo-spatial registration accuracy improves, but data transfer size increases

Engineering Contradiction:
Improvegeo-spatial registration accuracyVSAvoiddata transfer size
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent segments detailed 3D models into multiple levels of detail (LOD) organized as separate data layers. The system transmits only the appropriate layer based on the user's viewing distance and device capabilities, maintaining geo-spatial registration accuracy for close views while minimizing data transfer for distant views.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by transmitting only the necessary portion of the 3D model data required for the current viewing context. Instead of sending complete high-detail models, the system sends partial data (appropriate LOD layer) that suffices for the specific spatial context, reducing data transfer size while maintaining sufficient accuracy.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10055890B2Augmented reality for wireless mobile devices
Publication Date: 2018.08.21 ELBIT SYSTEMS OF AMERICA LLC
  • US10055890B2 patent drawing
  • US10055890B2 patent drawing
  • US10055890B2 patent drawing

AI summary

A model includes model layers on which a wireframe representation of objects located at geographic coordinates is stored in a memory such that surface detail of the objects increases from a base model layer to an uppermost model layer. Digital data layers stored in the memory that encompass digital coordinates corresponding with the geographic coordinates. Digital content for augmenting scenes is stored on pre-selected digital data layers at pre-selected digital coordinates on those layers. One or more of the digital data layers are logically linked with one or more of the model layers. When the location and spatial orientation of a mobile device in which a scene is viewed is received, the digital content on the digital data layer logically linked to one of the model layers is transmitted over a wireless communication channel to the mobile device.