Unlock instant, AI-driven research and patent intelligence for your innovation.

Real-time virtual hair try-on method based on three-dimensional head tracking

A three-dimensional, human head technology, applied in the field of real-time virtual hair trial, can solve the problems of poor wearing results and cumbersome operation process, and achieve the effect of realistic effect and enhanced experience.

Active Publication Date: 2021-05-14
ZHEJIANG GONGSHANG UNIVERSITY
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this kind of system will have the following main disadvantages: (1) Compared with the front angle, if the user inputs a photo of the side angle, the wearing effect is poor, and the selected hairstyle will not be changed according to the angle of rotation of the face
(2) If the user wants to observe the test hair effect from different angles, he needs to repeatedly provide photos from different angles, and the operation process is more cumbersome

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time virtual hair try-on method based on three-dimensional head tracking
  • Real-time virtual hair try-on method based on three-dimensional head tracking
  • Real-time virtual hair try-on method based on three-dimensional head tracking

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The present invention includes following three parts

[0023] Part 1: Training the Ear and Neck Splitters

[0024] (1) prepare the face picture database with ear mask and neck mask;

[0025] (2) Use the above data set to train the instance segmentation model to obtain the ear and neck segmentor.

[0026] Part II: Training the 3D head reconstruction model

[0027] (1) Construct a three-dimensional human head reconstruction model;

[0028] (2) Use the training set to train the 3D head reconstruction model to obtain the optimal network model parameters.

[0029] Part Three: Virtual Try-On

[0030] (1) prepare a three-dimensional hair model;

[0031] (2) Construct the three-dimensional human head of the try-on through the three-dimensional human head reconstruction model;

[0032] (3) Wear the three-dimensional hair model on the three-dimensional human head of the try-on and perform augmented reality drawing.

[0033] The overall process of the present invention is a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a real-time virtual hair try-on method based on three-dimensional head tracking. The method comprises the following steps: training a ear and neck divider; and then training a three-dimensional head reconstruction model, including constructing the three-dimensional head reconstruction model, training the three-dimensional head reconstruction model by using the training set, and obtaining optimal network model parameters by minimizing a key point loss function, a shape consistency loss function, an ear shape consistency loss function and a neck shape consistency loss function; and finally carrying out virtual try-on. According to the invention, the hair style is worn on the head of the subject in the three-dimensional space, so that the try-on effect is more vivid, the user experience is greatly improved, and technical support is provided for personalized image design, online shopping malls and the like.

Description

technical field [0001] The invention belongs to the field of augmented reality, and in particular relates to a real-time virtual trial launch method based on three-dimensional head tracking. Background technique [0002] As an important feature of personal image, hair is getting more and more attention in the era of pursuing individuality. Having a hairstyle that can enhance one's own image has become a part of people's daily work. If you go to a barber shop to verbally describe the hairstyle you want to the barber or choose a hairstyle in the hairstyle manual to get a haircut, it often happens that the trimmed hairstyle is not suitable for you and generally the result is difficult to change. At this time, if you can test whether the selected hairstyle is suitable for you before you get a haircut, the result may not be so bad. However, if you simulate the effect of haircuts by wearing wigs, just preparing a try-on wig for each hairstyle will lead to very high costs, and the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/11G06T15/00G06T19/00G06K9/62
CPCG06T7/11G06T19/006G06T15/005G06F18/214
Inventor 赵叶清杨柏林杨文武
Owner ZHEJIANG GONGSHANG UNIVERSITY