Interactive Fitting System Using Pose-Matched Image Sequences
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for virtual clothes fitting are either time-consuming, inconvenient, or result in unrealistic comparisons, failing to provide an efficient and user-friendly experience for consumers trying on clothes and accessories in physical stores.
Innovation Solution
An interactive display system using an image capturing device and processor to generate and compare image sequences of a user in different poses, allowing real-time comparison of clothing and accessories on a screen, with features like pose detection and codebook construction for accurate matching.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If virtual clothes fitting is performed using a camera to capture user images and add virtual clothes, then the fitting process becomes faster and less time-consuming, but the visual realism and accuracy of the fitting effect deteriorates
Solution Approach 1:
The patent uses actual captured images of the user wearing real clothes as templates, rather than generating virtual try-on images through software. The system captures real images during try-on and uses these as reference templates for comparison, ensuring high visual realism and accuracy while maintaining efficiency.
Solution Approach 2:
The patent replaces complex virtual reality equipment and mechanical fitting systems with a simple image capturing device (camera) and screen display system. This substitution achieves both time efficiency and visual accuracy by using actual photo capture and display rather than virtual rendering.
2Measurement precision
If photos or videos are captured while the user tries on each clothes for offline comparison, then the fitting comparison becomes more accurate, but the user experience deteriorates due to inconvenience and additional burden
Solution Approach 1:
The system automatically captures images during the try-on process and performs automatic comparison without requiring the user to manually take photos or videos. The image capturing device automatically records the try-on state, and the processor automatically compares images across different clothes items, eliminating the burden of manual operation while maintaining comparison accuracy.
Solution Approach 2:
The system provides real-time visual feedback by displaying captured images on the screen during the try-on process. The processor compares the current try-on image with previously captured images and displays the comparison results immediately, allowing users to see the effect without leaving the fitting area or performing additional actions.
3Device complexity
If the image capturing device captures images from the same side as the screen display, then the system complexity is reduced, but the measurement precision of pose matching may deteriorate
Solution Approach 1:
The patent extracts pose information from two-dimensional captured images by analyzing feature points and their spatial relationships. The processor identifies key feature points on the user's body in the captured image and calculates pose angles based on the geometric relationships between these points, achieving accurate pose detection without requiring three-dimensional sensing equipment.
Data Source
AI summary
An interactive clothes and accessories fitting method, a display system and a computer-readable recording medium thereof are provided, where the method includes the following steps. While the user is wearing a first apparel, images of the user are continuously captured by using an image capturing device to generate a first image sequence, wherein each first image that forms the first image sequence respectively corresponds to a different pose of the user. While the user is wearing a second apparel, images of the user are continuously captured by using the image capturing device. When a second comparison image corresponding to a specific pose of the user is captured by the image capturing device, a first comparison image corresponding to the specific pose is searched from the first image sequence, and the first comparison image and the second comparison image are simultaneously displayed on a screen.