Virtual Try-On Optical Refraction Rendering

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current virtual try-on techniques for eyeglasses fail to provide a realistic rendering of lenses with varying optical characteristics, limiting the ability to choose precise optical treatments and corrections.

Innovation Solution

A method that detects the face in a real or recorded image, realistically positions a virtual eyeglass frame, calculates the scene's representation through the lenses using refraction and depth maps, and merges this with the initial image to create a realistic final image, allowing for precise appreciation of optical deformations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual try-on techniques are used to display eyeglass frames, then users can virtually try on frames, but the optical characteristics of lenses (corrections and treatments) cannot be realistically represented

Engineering Contradiction:

Improvevirtual try-on capabilityVSAvoidoptical rendering accuracy

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent introduces an intermediary computational process that simulates optical refraction through virtual lenses. This intermediary layer between the user and the virtual try-on system enables realistic representation of optical characteristics by calculating how light would actually pass through lenses with specific corrections and treatments, thereby resolving the contradiction between virtual display capability and optical rendering accuracy.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies parameter changes by varying the refractive index and optical properties of virtual lenses to match real lens specifications. By dynamically adjusting these optical parameters based on the selected lens type (different corrections and treatments), the system achieves accurate optical rendering while maintaining versatile virtual try-on functionality across multiple frame and lens combinations.

Inventive Principle:

Principle #35Parameter changes

2Ease of manufacture

If optical effects are added via overlay to simulate lens appearance, then some visual characteristics can be shown, but precise optical deformations and corrections cannot be accurately represented

Engineering Contradiction:

Improveoverlay implementationVSAvoidoptical deformation accuracy

Core Design Contradiction:

Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent replaces the simple overlay mechanism with a computational optics system that uses ray-tracing algorithms to simulate light refraction. This substitution transforms the approach from merely displaying static optical effects to dynamically calculating and rendering accurate optical deformations, thereby achieving measurement precision in representing optical corrections while maintaining the ease of digital implementation.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If limited optical effects are used in virtual try-on, then system complexity is reduced, but the ability to assist users in choosing precise optical treatments is compromised

Engineering Contradiction:

Improvesystem complexityVSAvoidoptical treatment selection capability

Core Design Contradiction:

Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent segments the optical system into distinct virtual lens components, each with specific refraction properties corresponding to different optical corrections and treatments. This segmentation allows the system to manage complexity by breaking down the overall optical simulation into manageable lens elements, while simultaneously enabling versatile selection of various optical treatments by combining different segmented components.

Inventive Principle:

Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables a realistic virtual try-on of eyeglasses with accurate representation of optical corrections and treatments, allowing users to test and choose the best combination of frames and lenses for their needs.

Implementation Method 1

calculating a representation of the scene perceived from the virtual camera through the ophthalmic lens or lenses according to the refraction of the ophthalmic lens or lenses

Methodology Applied

Scientific EffectRefraction: Refraction

Data Source

PatentUS11494989B2Method allowing an individual to realistically try on a pair of spectacles virtually

Publication Date: 2022.11.08 FITTINGBOX

AI summary

A method for generating a final image of an individual from an initial image of the individual acquired by a camera, the image being a still or contained in a video stream. The method includes detecting the face of the individual in the initial image, realistic positioning of a virtual frame on the face of the individual, generating an overlay that is superimposed on the initial image, the overlay comprising a projection of all or a portion of the virtual frame, generating the final image by merging the overlay with the initial image. The frame includes at least one ophthalmic lens characterized by an optical correction and/or an optical treatment. The method also includes, before the final step, a step of calculating the rendering of the ophthalmic lens according to the refraction of the ophthalmic lens and of a depth map of the initial image.