Markerless AR Virtual Object Interaction via Command Mediator
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) technologies, particularly markerless-based AR, are limited in allowing virtual objects to interact with each other in a meaningful way, primarily enabling only passive viewing without communication or action between rendered virtual objects.
Innovation Solution
A method and system that includes a computing device equipped with an object detection module, a rendering module, and a command processing module to detect physical objects, render virtual objects at desired positions, and enable communication and action between them through command processing, allowing virtual objects to interact and perform actions in a markerless AR framework.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If markerless-based AR is used to render virtual objects in a real environment, then the flexibility and ease of operation are improved, but the capability for virtual object interaction and communication deteriorates
Solution Approach 1:
The patent introduces a command processing module as an intermediary that enables communication between virtual objects. This module receives commands from one virtual object, processes them according to predefined protocols, and executes appropriate actions on target virtual objects, thereby establishing interaction capabilities without requiring markers or complex setup procedures
Solution Approach 2:
The command processing module is designed with universal functionality to handle multiple types of interactions between different virtual objects. It supports various command types (movement, transformation, action triggering) and can work with any rendered virtual object, making the interaction system versatile across different AR scenarios while maintaining the simplicity of markerless operation
2Productivity
If virtual objects are rendered for passive viewing, then the rendering performance is improved, but the interactivity and communication capability between virtual objects deteriorates
Solution Approach 1:
The command processing module serves as a mediator that adds communication functionality without interfering with the rendering pipeline. It operates at the logic layer, receiving and processing interaction commands separately from the rendering operations, thus maintaining high rendering performance while enabling virtual object communication through a dedicated command processing channel
3Adaptability or versatility
If a command processing module is added to enable virtual object communication, then the interaction capability is improved, but the device complexity increases
Solution Approach 1:
The command processing module is merged with the existing AR framework components, sharing the same processing thread and memory space. It integrates with the rendering module and object detection module through existing interfaces, combining multiple functions (object detection, rendering, and command processing) into a unified system that reduces overall complexity compared to separate independent modules
Data Source
AI summary
A method and computing device for providing Augmented Reality (AR) is provided. The method of providing AR includes detecting at least one physical object from a real scene obtained through a camera of a computing device, rendering at least one virtual object at a desired position of the detected at least one physical object on the real scene provided on a display, enabling communication through a command for interaction between the rendered at least one virtual object, and enabling the at least one virtual object to perform an action in response to command communication between the at least one virtual object.