Dynamic AR Image Compression by Perceived Viewing Distance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality (AR) technologies face challenges in efficiently compressing and transmitting high-quality AR content over networks, leading to reduced fidelity and increased bandwidth usage, especially when AR objects are positioned at varying distances and depths within a real-world scene.

Innovation Solution

A method and system that dynamically compress AR content based on real-world distance and relative depth information, allowing for varying compression factors for different portions of AR objects and scenes, ensuring high fidelity for closer objects and lower fidelity for more distant ones, thereby optimizing network bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If uniform high compression is applied to all AR content, then network bandwidth usage is reduced, but fidelity and quality of distant AR objects deteriorate

Engineering Contradiction:
Improvenetwork bandwidth usageVSAvoidfidelity of AR objects
Core Design Contradiction:
Loss of energyVSManufacturing precision

Solution Approach 1:

The patent applies different compression factors to different spatial regions of the AR scene based on their distance from the user. Close AR objects use lower compression factors to maintain high fidelity, while distant objects use higher compression factors to reduce bandwidth. This local differentiation resolves the contradiction by optimizing both bandwidth efficiency and visual quality in a region-specific manner.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The compression factors are dynamically adjusted based on real-time distance information between the user and AR objects. As users move closer to or farther from AR objects, the compression factors are updated accordingly, maintaining optimal balance between bandwidth usage and visual quality throughout the interaction.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If uniform low compression is applied to all AR content, then fidelity and quality of AR objects are maintained, but network bandwidth consumption increases

Engineering Contradiction:
Improvefidelity of AR objectsVSAvoidnetwork bandwidth usage
Core Design Contradiction:
Manufacturing precisionVSLoss of energy

Solution Approach 1:

Instead of applying uniform low compression, the system applies high compression only to distant AR objects where visual quality degradation is less noticeable, while maintaining low compression for close objects. This spatially-varying approach maintains overall fidelity while significantly reducing total bandwidth consumption.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system applies compression selectively rather than uniformly. By applying high compression only where necessary (distant objects) and low compression where critical (close objects), the system achieves adequate overall quality with reduced bandwidth usage compared to uniform low compression.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of energy

If high compression is applied to distant AR objects, then network bandwidth usage is reduced, but visual quality and detail of those objects deteriorate

Engineering Contradiction:
Improvenetwork bandwidth usageVSAvoidvisual detail of AR objects
Core Design Contradiction:
Loss of energyVSLoss of information

Solution Approach 1:

The patent dynamically changes compression parameters based on spatial characteristics (distance from user). This allows the system to adapt visual quality to viewing conditions, maintaining acceptable visual detail for distant objects while maximizing bandwidth efficiency through higher compression where appropriate.

Inventive Principle:
Principle #32Color changes

Data Source

PatentUS11995870B2Dynamic image compression based on perceived viewing distance
Publication Date: 2024.05.28 CITRIX SYSTEMS INC
  • US11995870B2 patent drawing
  • US11995870B2 patent drawing
  • US11995870B2 patent drawing

AI summary

An important aspect of augmented reality (AR) is that digital information, such as rendered images of AR scenes and objects, are integrated with the user's view of the real world in real time. However, transmitting large images over the network may negatively impact the real time aspect of the AR experience. Methods and systems for dynamic image compression based on perceived viewing distance are described herein. In some implementations, image compression of streaming AR content is based on real world distances of AR objects relative to a user or client device. In some implementations, image compression of streaming AR content is based on relative depth information. In some implementations, image compression of streaming AR content is based on a type of information or content associated with an AR object. The dynamic image compression based on perceived viewing distance provided by the systems and methods disclosed herein may also be applied to video codecs.