Virtual Try-On Body Model Generation from User Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for online shopping, such as using 3D models or overlaying clothes on user images, fail to provide a realistic virtual try-on experience due to inaccuracies in body measurements, skin tone, and facial features, leading to difficulties in predicting how clothes will look and feel on the user.
Innovation Solution
A method that processes user images to generate a realistic body model, incorporating facial features and body information to accurately fit and display clothing, allowing for virtual try-on with adjustable layers, expressions, and ambient lighting.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If 3D models are generated to provide virtual try-on experience, then the wearing experience can be provided to users, but the process is time consuming and produces unrealistic results
Solution Approach 1:
The patent creates a digital copy of the user's body by processing a single photograph to extract body measurements, contours, and facial features. This copy (virtual avatar) replicates the user's physical characteristics accurately, enabling virtual try-on without time-consuming 3D model generation. The system copies essential body parameters from the photo to construct a realistic virtual representation.
Solution Approach 2:
The system performs preliminary action by pre-processing the user's photograph to extract and store body measurements, contours, and facial features before the actual try-on process. This preliminary extraction creates a ready-to-use virtual avatar that can immediately display clothing items, eliminating the need for time-consuming real-time 3D modeling during the shopping experience.
2Ease of operation
If clothes are shown on models with particular body measurements, then some wearing experience is provided, but users cannot accurately match their size or perceive how the cloth will look on their specific body
Solution Approach 1:
The patent applies local quality by creating a virtual avatar that replicates the user's specific local body characteristics - exact body contours, measurements, skin tone, and facial features. Instead of using generic models with standardized proportions, the system customizes each attribute of the virtual representation to match the user's unique physical properties, enabling accurate size matching and personalized visualization.
3Ease of manufacture
If user uploads photo and drags cloth image onto it, then simple overlay is achieved, but zoom in-zoom out is problematic, placement is inaccurate, and multiple layers are not possible
Solution Approach 1:
The patent introduces an intermediary - the virtual avatar - between the user's photograph and the clothing images. This intermediary serves as a standardized canvas with defined body geometry and proportions, enabling accurate cloth placement, realistic draping simulation, and proper scaling. The avatar mediates the interaction between clothing items and the user's body, solving placement accuracy issues while maintaining ease of use.
Data Source
AI summary
A method for generating a body model of a person wearing a cloth includes receiving an user input related to a person, wherein the user input comprises at least one image or photograph of the person, wherein at least one image of the person has face of the person, using a human body information to identify requirement of the other body part/s, receiving at least one image or photograph of other human body part/s based on identified requirement, processing the image/s of the person with the image/s or photograph/s of other human body part/s using the human body information to generate a body model of the person, wherein the body model represent the person whose image/photograph is received as user input, and the body model comprises face of the person, receiving an image of a cloth according to shape and size of the body model of the person, and combining the body model of the person and the image of the cloth to show the body model of the human wearing the cloth. The human body information comprises at least one of orientation of face of the person in the image of the person, orientation of body of the person in the image of the person, skin tone of the person, type of body part/s shown in the image of person, location and geometry of one or more body parts in image of the person, body/body parts shape, size of the person, weight of the person, height of the person, facial feature information, or nearby portion of facial features, or combination thereof. The facial feature information comprises at least one of shape or location of at least face, eyes, chin, neck, lips, nose, or ear, or combination thereof.