Dynamic Mesh Surface Attachment for Deformable AR Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality software lacks the ability to dynamically adjust and deform virtual objects in response to the movements and deformations of the parent object, leading to unrealistic appearances and limited user experience.
Innovation Solution
A mechanism called 'mesh surface constraint' is introduced, allowing virtual objects to be attached to a target mesh surface with precision, enabling dynamic adjustments in texture orientation, position, and vertex normal alignment to match the movements and deformations of the target mesh surface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If virtual objects are parented to other objects within the 3D space, then the child object follows the position and orientation of the parent object, but the child object does not deform with the parent object's movements, resulting in an unrealistic appearance
Solution Approach 1:
The patent segments the parent object into a base mesh and a deformable mesh, allowing the virtual object to be attached to specific deformable regions rather than the entire parent object. This enables the virtual object to follow and deform with specific body parts (like facial features) while maintaining stable attachment to the overall structure.
Solution Approach 2:
The patent implements dynamic attachment by allowing the virtual object to be attached to deformable mesh surfaces that change shape and position in real-time. The attachment point moves with the deformable mesh, enabling the virtual object to adapt its position and orientation dynamically as the parent object moves and deforms.
2Stability of the object's composition
If virtual objects are attached to the parent object, then the virtual object remains stable, but the virtual object fails to adapt to the avatar's facial expressions and movements
Solution Approach 1:
The patent applies local quality by attaching the virtual object to specific deformable mesh surfaces corresponding to facial features (eyes, mouth, nose) rather than the entire face. Each attachment point is tied to local mesh deformation, allowing the virtual object to adapt to specific facial expressions while maintaining stable attachment to the overall face structure.
3Ease of manufacture
If conventional object parenting is used, then the setup process is simple, but the visual realism and quality of augmented reality effects are limited
Solution Approach 1:
The patent introduces deformable mesh surfaces as intermediaries between the parent object and the virtual object. These deformable meshes serve as a mediator layer that translates parent object movements and deformations into corresponding virtual object adjustments, enabling realistic visual effects while maintaining a relatively simple attachment setup process.
Data Source
AI summary
A computing device for displaying a 3D virtual object for an augmented reality (AR) scene is described. The computing device has a processor and a non-transitory computer-readable memory, where the processor is configured to carry out instructions from the memory that configure the computing device to: determine a polygon mesh representation of a target object within the AR scene, where the polygon mesh representation models a physical appearance of the target object; identify a target mesh surface of the polygon mesh representation onto which the 3D virtual object should be anchored; monitor the target object and updating the polygon mesh representation according to changes in the physical appearance of the target object; and display the 3D virtual object within the AR scene according to a position of the target mesh surface on the updated polygon mesh representation, where the target mesh surface moves along with the target object.