AR Mirror Overlaying Apparel Using Skeleton Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current smart mirror technologies for augmented reality in retail and fashion require high computational power, are expensive, and lack portability, making them inefficient for mass usage and unable to provide real-time virtual try-on options outside of studio settings.

Innovation Solution

An augmented reality display system that includes a reflective and dispersive coating on a mirror, a scanning system, and a processor to analyze 3D body scans, estimate feature positions, and overlay product recommendations in real-time, allowing for efficient and portable virtual try-on experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional computer vision techniques are used for extracting 3D scans and surface body models, then measurement precision and feature accuracy are improved, but device complexity and computational requirements increase significantly

Engineering Contradiction:
Improvefeature accuracyVSAvoidcomputational requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential information needed for virtual try-on from the 3D body scan, specifically surface body models and skeleton points, while discarding unnecessary detailed geometric data. This selective extraction reduces computational complexity while maintaining the required measurement precision for apparel fitting and feature detection.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the complex 3D body scanning process into distinct functional components: capturing 3D body shape, extracting surface models, identifying skeleton points, and overlaying virtual apparel. This segmentation allows each component to be optimized independently, reducing overall system complexity while maintaining precision through specialized processing at each stage.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If studio-like equipment is used for capturing detailed 3D scans, then manufacturing precision and measurement accuracy are improved, but ease of operation and portability deteriorate

Engineering Contradiction:
Improve3D scan accuracyVSAvoidportability
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent creates a digital 3D copy of the user's body geometry through scanning, which can then be stored and processed without requiring the physical studio equipment to be transported. The 3D body model serves as an accurate replica that maintains measurement precision while enabling the system to be deployed in various locations including retail stores and homes, significantly improving portability and ease of operation.

Inventive Principle:
Principle #26Copying

3Productivity

If real-time 3D body scanning and virtual try-on processing is implemented, then productivity and user experience are improved, but use of energy and computational power increase

Engineering Contradiction:
Improvereal-time processing speedVSAvoidcomputational power consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent performs preliminary processing of the 3D body scan by pre-extracting surface body models and skeleton points before the actual virtual try-on rendering. This preliminary action prepares the essential geometric data in advance, reducing the computational power and energy required during real-time apparel overlay and rendering operations, thereby maintaining high productivity while lowering energy consumption.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient and portable real-time virtual try-on capabilities, reducing computational requirements and costs while providing accurate product recommendations based on user body metrics, enhancing user experience and retail accessibility.

Implementation Method 1

The augmented reality mirror may include a reflective coating on a first region of the augmented reality mirror

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

The augmented reality mirror may include a dispersive coating on a second region of the augmented reality mirror

Methodology Applied
Scientific EffectDispersion: Dispersion (of waves)

Data Source

PatentUS10665022B2Augmented reality display system for overlaying apparel and fitness information
Publication Date: 2020.05.26 PERFECTFIT SYST PVT LTD
  • US10665022B2 patent drawing
  • US10665022B2 patent drawing
  • US10665022B2 patent drawing

AI summary

The present disclosure relates to an augmented reality display system. The augmented reality display system includes an augmented reality mirror, a display device, a scanning setup and a data processing system. The data processing system receives the first set of data of a user and collects the second set of data associated with the user. Moreover, the data processing system analyzes the first and second set of data in real time and estimates the position of each feature of the body of the user. Also, the data processing system slices each feature of the body of the user to measures a set of feature metrics. Further, the data processing system create one or more feature metric databases. Moreover, the data processing system maps the feature metric database with a pre-defined set of products. The data processing system overlay and display the information related to the fitness, health and apparel.