AR Shoe Try-On Rendering With Calf Occlusion Handling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a discrepancy between how shoes appear in virtual reality and how they look when actually worn, making it difficult for users to choose the right shoes based on visual representations alone.
Innovation Solution
A method and apparatus using augmented reality to collect a real image, determine an initial rendering area and occlusion area based on calf images, and render a target area with a shoe mold to create an enhanced shoe mold image, providing an immersive try-on experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If VR is used to display shoe pictures, then users can browse shoes conveniently, but the visual representation does not accurately reflect how shoes look when actually worn
Solution Approach 1:
The patent creates a virtual copy of the shoe that can be overlaid onto a real-time image of the user's foot. This virtual shoe copy maintains the visual appeal of product photography while adding the capability to see how it looks on the actual foot through AR technology.
Solution Approach 2:
The patent introduces an AR intermediary layer that combines the virtual shoe representation with the real foot image. This intermediary approach allows users to see both the idealized product view and the realistic wearing effect simultaneously, resolving the contradiction between convenience and accuracy.
2Loss of information
If the entire shoe mold is rendered in the initial rendering area, then complete shoe visualization is achieved, but the occlusion relationship with the calf is not maintained, reducing realism
Solution Approach 1:
The patent divides the rendering area into two distinct segments: the initial rendering area for complete shoe visualization and the occlusion area where the calf image should remain visible. This segmentation allows the system to maintain both complete shoe display and realistic occlusion effects.
Solution Approach 2:
The patent applies different rendering qualities to different regions: the initial rendering area displays the complete shoe mold for full visualization, while the occlusion area maintains the original calf image for realism. This local differentiation resolves the contradiction between completeness and realism.
Data Source
AI summary
A shoe try-on method and apparatus based on augmented reality, and an electronic device. The method comprises: upon detecting a shoe try-on instruction, determining, according to any calf image in a real image that is collected in real time, an initial rendering area corresponding to the calf image; according to all the calf images in the real image, determining a shielding area; and then determining a target rendering area according to the shielding area and the initial rendering area. Therefore, it is only necessary to perform shoe mold rendering on the target rendering area.