AR Virtual Avatar Interaction with Physical Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented reality applications, remote users controlling virtual avatars are often unaware of the location and properties of physical objects in the viewer's environment, leading to improper interactions and disruptions in the AR experience.
Innovation Solution
The system identifies physical objects and their properties within the viewer's environment, transmitting this information to remote users. When a virtual object approaches a physical object, the system modifies the virtual object's pose and appearance to interact realistically with the physical object, based on its properties.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If remote users control virtual avatars without providing object information, then the system complexity is reduced, but the interaction authenticity deteriorates
Solution Approach 1:
The system performs preliminary identification and analysis of physical objects in the environment before the virtual avatar interacts with them. Object properties such as material, shape, and physical characteristics are detected and stored in advance using sensors and image processing, so that when the avatar approaches an object, the interaction can be immediately adjusted based on pre-analyzed properties without adding real-time complexity
Solution Approach 2:
The patent introduces an intermediary component that acts as a bridge between the physical environment and the virtual avatar. This intermediary processes physical object data and translates it into interaction parameters for the virtual avatar, mediating the complexity by handling object recognition and property analysis separately from the avatar control system
2Reliability
If the system identifies and processes object properties, then the interaction realism is improved, but the processing time increases
Solution Approach 1:
Object properties are identified and processed in advance before interaction occurs. The system continuously monitors and stores physical object characteristics such as material composition, geometric shape, and physical state, so that when a virtual avatar needs to interact with an object, the processing is already complete and the results are immediately available
Solution Approach 2:
The system processes only the essential object properties needed for interaction rather than analyzing every detail. It focuses on key characteristics like material type, shape category, and physical state that are sufficient for realistic interaction, avoiding excessive processing of irrelevant details
3Reliability
If virtual objects interact with physical objects based on properties, then the AR experience quality is improved, but the computational resources required increase
Solution Approach 1:
The system applies different levels of interaction complexity based on the specific properties of each physical object. For example, interactions with rigid objects use simpler collision models while interactions with deformable objects use more complex simulations. This local adaptation of interaction quality ensures computational resources are used efficiently while maintaining realistic experience where needed
Solution Approach 2:
The system dynamically adjusts interaction parameters based on detected object properties. When an object is identified, the system modifies physical parameters such as collision response, friction coefficients, and material properties to match the real object, enabling realistic interaction without requiring full-scale complex simulations for all objects
Data Source
AI summary
A method, an electronic device and computer readable medium for augmented reality object interaction. The method includes identifying an object within an area and properties associated with the object. The method also includes transmitting, to a remote electronic device, object information associated with the object. The method further includes receiving, from the remote electronic device, information including a virtual object, representing a remote user. Additionally, the method includes displaying the virtual object within the area. In response to determining that the virtual object is within a threshold distance from the object, the method also includes modifying the virtual object to interact with the object based on the properties of the object.