AR Object Selection via Media Stream Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality systems lack efficient methods to seamlessly integrate virtual objects with real-world environments, particularly in delivering media streams to receiving devices, such as smartphones and head-mounted displays, without requiring extensive user interaction or complex processing.

Innovation Solution

A system that accesses and synchronizes media streams from both receiving and user devices, using metadata and context analysis to identify virtual objects and apply transformational information for rendering these objects in the user's field of view, allowing for real-time augmentation of the real-world environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If automated object selection and placement is implemented in augmented reality systems, then user interaction complexity is reduced and processing efficiency is improved, but system complexity increases due to the need for metadata synchronization and context analysis between multiple devices

Engineering Contradiction:
Improveuser interaction complexityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a server as an intermediary component that receives media streams from a first device, performs context analysis, and sends augmented media streams to a second device. This intermediary handles the complex processing of metadata synchronization and object selection, shielding users from system complexity while enabling automated AR experiences. The server acts as a mediator that manages the communication and data exchange between multiple devices, resolving the technical contradiction by centralizing complex operations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If real-time media stream synchronization and context analysis are performed across multiple devices, then augmented reality experience quality is improved, but processing time and computational load increase

Engineering Contradiction:
Improveaugmented reality experience qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary context analysis on media streams received from the first device before transmitting them to the second device. By pre-processing the media streams and identifying relevant objects in advance, the system reduces the computational burden during real-time rendering. This preliminary action allows for optimized object selection and placement, improving AR experience quality while minimizing processing delays during actual augmented reality delivery.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If extensive metadata handling and context analysis are performed to identify virtual objects, then object placement accuracy is improved, but computational resources and processing load increase

Engineering Contradiction:
Improveobject placement accuracyVSAvoidcomputational resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts and utilizes specific metadata from media streams to identify virtual objects and their properties. By selectively extracting only the necessary metadata elements required for accurate object placement (such as spatial coordinates, object identifiers, and contextual information), the system achieves high placement accuracy without processing unnecessary data. This extraction approach minimizes computational resource consumption while maintaining precision in virtual object positioning within the augmented reality environment.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11482192B2Automated object selection and placement for augmented reality
Publication Date: 2022.10.25 ARRIS ENTERPRISES LLC
  • US11482192B2 patent drawing
  • US11482192B2 patent drawing
  • US11482192B2 patent drawing

AI summary

A system to facilitate AR processing includes receiving captured media from a user device and context information relating to media that is being delivered to a receiving device. The system may use the media being delivered with the captured media to generate one or more virtual objects. The user device may augment a user's view of reality that is reflected in the captured media by overlaying or otherwise incorporating the virtual objects in the user's view of reality.