Simplified 3D Spectacles Modeling for Real-Time Virtual Try-On
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality and augmented reality solutions for virtual trying on of glasses lack realism and interactivity, requiring large data amounts and significant processing time.
Innovation Solution
A method for modeling virtual glasses and integrating them photorealistically into photographs or videos, involving detection of object placement zones, determination of characteristic points, geometric modeling, texture application, and light interaction simulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If virtual reality or augmented reality solutions are used for virtual trying on of glasses, then interactivity is improved, but data requirements and processing time increase significantly
Solution Approach 1:
The patent creates a simplified 3D model that copies only the essential geometric features and visual appearance of real glasses, rather than using complete high-fidelity 3D models. This allows the virtual glasses to be rendered efficiently with minimal data while maintaining visual realism for the try-on experience
Solution Approach 2:
The patent transforms detailed 3D model data into a simplified representation by changing the parameter complexity - using reduced polygon counts, simplified material properties, and optimized geometric parameters that maintain visual fidelity while dramatically reducing data requirements and processing loads
2Ease of operation
If virtual reality or augmented reality solutions are used for virtual trying on of glasses, then interactivity is improved, but processing time increases significantly
Solution Approach 1:
The patent creates a simplified 3D model that copies only the essential geometric features and visual appearance of real glasses, rather than using complete high-fidelity 3D models. This allows the virtual glasses to be rendered efficiently with minimal data while maintaining visual realism for the try-on experience
Solution Approach 2:
The patent performs preliminary processing to create the simplified 3D model structure and pre-computes essential geometric properties before the actual virtual try-on operation. This preliminary preparation enables rapid real-time rendering and interaction without requiring complex computations during the user experience
3Quantity of substance
If simplified geometric model is used for virtual glasses, then data requirements are reduced, but modeling precision may be compromised
Solution Approach 1:
The patent applies local quality by concentrating geometric detail only where visually critical - such as the frame contours, lens boundaries, and key structural features - while using simplified geometry in less visible areas. This selective detail distribution maintains visual realism and modeling precision where needed while minimizing overall data requirements
Data Source
Figure 1a~1d
Figure 2~3
Figure 4~5
AI summary
The invention relates to a method for determining a simplified geometric model (6) of a model of a pair of real glasses (4), said model consisting of a predetermined number N of faces and their normals by taking as orientation of these normals, the exterior of the convex envelope to the real pair of glasses (1). The simplified geometric model (6) of a real pair of glasses (4), consisting of a frame (4a) and lenses (4b), is obtained in a phase 100 in which: - a set of views of the pair of real glasses (4) to be modeled, with different viewing angles, - the simplified geometric model (6) is constructed, consisting of a number N of faces facej and their normal nj starting from a sparse surface mesh, and using an optimization algorithm that deforms the mesh of the model so that the projections of its silhouette in each of the views best match the silhouettes detected in the images.