AR Digital Assistant Virtual Object Placement via Host Server

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality technologies lack efficient systems for dynamic virtual object placement and interaction within physical environments, and there is a need for seamless integration of virtual and physical worlds to enhance user engagement and interaction.

Innovation Solution

The development of a system that includes a host server and client devices with AR/VR software agents, sensors, and a marketplace for on-demand sensor data, enabling the deployment of virtual objects, digital assistants, and interactive content, along with a registry and directory for AR/VR content, allowing for precise location determination and dynamic adjustment of virtual object perceptibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual objects are placed in augmented reality environments, then user engagement and interaction are enhanced, but precise placement and integration with physical world require complex systems

Engineering Contradiction:
Improveuser engagementVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a host server as an intermediary that coordinates between client devices, sensors, and virtual object placement systems. The host server receives sensor data, determines optimal placement locations, and manages the registry of virtual objects, thereby reducing the complexity burden on individual client devices while enabling precise and adaptive virtual object placement in augmented reality environments.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If real-time data integration is implemented for dynamic virtual object adjustment, then interaction quality improves, but data processing requirements and system resources increase

Engineering Contradiction:
Improveinteraction qualityVSAvoiddata processing resources
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent implements preliminary action by having client devices continuously capture and pre-process sensor data (images, video, depth information) before virtual object placement is needed. The host server pre-establishes a registry of virtual objects and their potential placement locations. This pre-processing reduces the computational burden during real-time interaction, as the system only needs to match current sensor data against pre-analyzed options rather than processing everything from scratch.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If precise location determination is achieved for virtual object placement, then placement accuracy improves, but measurement and detection complexity increases

Engineering Contradiction:
Improveplacement accuracyVSAvoiddetection complexity
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent merges multiple sensing modalities (cameras, depth sensors, GPS, accelerometers) into a unified location determination system. By combining data from these different sensors and processing them together through the host server, the system achieves high placement accuracy without requiring any single sensor to be overly complex. The registry system further simplifies detection by pre-categorizing virtual objects and their suitable placement contexts.

Inventive Principle:
Principle #5Merging (Combining)

4Adaptability or versatility

If dynamic adjustment of virtual object perceptibility is enabled, then user experience is enhanced, but control and measurement complexity increases

Engineering Contradiction:
Improveuser experienceVSAvoidcontrol complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamics by enabling virtual objects to be dynamically adjusted in terms of their perceptibility, visibility, and interaction properties based on user context, location, and behavior. The host server continuously monitors user interactions and sensor data, then dynamically updates the registry entries for virtual objects to adjust their display characteristics, accessibility, and interaction modes, providing an adaptive user experience without requiring complex local control logic on client devices.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11494991B2Systems, methods and apparatuses of digital assistants in an augmented reality environment and local determination of virtual object placement and apparatuses of single or multi-directional lens as portals between a physical world and a digital world component of the augmented reality environment
Publication Date: 2022.11.08 ADEIA MEDIA HOLDINGS INC
  • US11494991B2 patent drawing
  • US11494991B2 patent drawing
  • US11494991B2 patent drawing

AI summary

Systems and methods of digital assistants in an augmented reality environment and local determination of virtual object placement are disclosed. Apparatuses of single or multi-directional lens as portals between a physical world and a digital world component of the augmented reality environment are also disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, to present, a digital assistant to the user. Responsive to receiving a command, the digital assistant can trigger an operation on the augmented reality environment such that the user is able to engage with the augmented reality environment via the user interface. The method can further include training the digital assistant to learn from the activities occurring in the augmented reality environment and/or behaviors of the user from the action or the interaction with the real world environment.