Virtual Accessory Pose Alignment for Stable AR Try-On
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current AR applications for virtual accessory try-on suffer from poor fitting degree, followability, and stability, particularly due to the high degree of freedom in human body parts, leading to issues like model penetration and instability during movement.
Innovation Solution
An image processing method that determines key points and a six-degree-of-freedom pose value to adjust a virtual accessory carrier model, calculating adjustment parameters based on edge points and key points to simulate the real pose and improve fitting, while avoiding model penetration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a virtual accessory carrier model is used for AR try-on, then the user can experience virtual try-on effects, but the fitting degree and stability are poor due to high degree of freedom in human body parts
Solution Approach 1:
The patent applies parameter changes by adjusting the degree of freedom of the virtual accessory carrier model from six degrees to three degrees. This reduction in parameters constrains the model's movement to only translation along the optical axis, preventing unrealistic rotations and improvements stability while maintaining the virtual try-on capability
Solution Approach 2:
The patent introduces a virtual accessory carrier model as an intermediary between the user's actual accessory carrier and the virtual accessory. This carrier model serves as a mediator that can be precisely positioned and oriented to achieve realistic fitting effects without requiring full six-degree-of-freedom freedom
2Speed
If the virtual accessory carrier model follows the accessory carrier's movement, then the followability improves, but model penetration occurs due to overlapping areas in three-dimensional space
Solution Approach 1:
The patent applies preliminary action by pre-defining the virtual accessory carrier model's position and orientation relative to the accessory carrier before movement occurs. The model is positioned at a predetermined distance and oriented at a predetermined angle, ensuring it follows the carrier's movement without penetrating into the accessory model's space
Solution Approach 2:
The patent changes the positional parameters of the virtual accessory carrier model by setting a predetermined distance from the accessory carrier and constraining its orientation to predetermined angles. This parameter configuration allows the model to follow the carrier's movement while maintaining proper spatial separation to avoid penetration
3Manufacturing precision
If the virtual accessory carrier model is adjusted to match the accessory carrier's pose, then the fitting degree improves, but the model may penetrate the virtual accessory model
Solution Approach 1:
The patent applies parameter changes by adjusting the virtual accessory carrier model's position and orientation parameters to match the accessory carrier's pose. The model is positioned at a predetermined distance and oriented at predetermined angles relative to the carrier, achieving realistic fitting while preventing penetration into the virtual accessory model's space
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
This application provides a method, an apparatus, an electronic device, and a storage medium for image processing, comprising: performing a key point prediction on an accessory carrier image, and determining a six-degree-of- freedom pose value based on the first key point obtained by prediction; adjusting the pose of the virtual accessory carrier model based thereon, and obtaining first edge points of the adjusted model; calculating an adjustment parameter based on the first edge points and second key points, and obtaining a target virtual accessory carrier model based on the adjustment parameter; the virtual accessory carrier model being mounted with a virtual accessory model, and obtaining a corresponding accessory image; and rendering the accessory image to the accessory carrier image. According to the present application, the pose adjustment and model optimization are performed on the virtual accessory carrier model by determining the key points of the accessory carrier, the six-degree-of-freedom pose value and the adjustment parameter, the real wearing effect of the accessory at a specific angle is simulated by obtaining the image of the virtual accessory model, finally the accessory is more attached to the carrier, and the rendering effect of the carrier wearing accessory is improved during motion.