Unlock instant, AI-driven research and patent intelligence for your innovation.

Method, device and system for intelligent hairstyle recommendation based on neural network and unity

A technology of neural network and recommendation method, applied in the field of intelligent hairstyle recommendation, can solve the problems of single standard, poor experience effect, heavy workload, etc., and achieve high practicability, good prediction effect, and vivid effect

Active Publication Date: 2022-07-26
SOUTH CHINA UNIV OF TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

More importantly, these two types of software can only provide some materials for users to choose, without the function of intelligently recommending styles suitable for users, and the display results are limited to the user's frontal face, and cannot show the overall effect of the styling, right? For users who are familiar with the shape design, the experience effect is poor and cannot meet their individual needs
[0004] In the prior art, a virtual test hair realization method based on WebGL and face reconstruction is provided, but the method has the following problems: (1) the recognition rate is low, and the method divides the face shape into heart-shaped face, square face, rectangular face, ellipse Face, round face, plan to use convolutional neural network to recognize face shape
(2) Single standard
(3) Poor convenience and uncertain market application prospects
Therefore, the market application prospect of this method is uncertain.
(4) Lack of data sets
However, in actual engineering practice, its feasibility is not high
The reasons are: 1. To train a multi-category network, the data set must be at least on the order of ten thousand
The production of the dataset not only includes crawling photos, but also includes preprocessing work such as cutting faces, and they need to be labeled manually. The workload is quite large and the quality of the dataset cannot be guaranteed.
2. Even if the data set is completed, if the neural network is to recognize the deep features of the face shape, the results obtained by training the neural network from scratch are still not ideal

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, device and system for intelligent hairstyle recommendation based on neural network and unity
  • Method, device and system for intelligent hairstyle recommendation based on neural network and unity
  • Method, device and system for intelligent hairstyle recommendation based on neural network and unity

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0062] like figure 1 As shown, this embodiment provides an intelligent hairstyle recommendation method based on neural network and Unity, including the following steps:

[0063] S1: Collect the mapping relationship between facial features and hairstyle attributes and establish a facial feature-hairstyle attribute mapping table;

[0064] In this embodiment, the user's facial features are divided into 8 two-category indicators. They are: index 1 - forehead length, index 2 - forehead width, index 3 - atrium length, index 4 - face length, index 5 - face width, index 6 - protruding jawbone, index 7 - eye spacing Too wide, indicator eight - whether it is an oval face. The corresponding relationship between facial features and hairstyles in this embodiment is shown in Table 1 below. There are different data processing methods for different facial features, and different neural network architectures are used for network training.

[0065] Table 1. Mapping relationship between facia...

Embodiment 2

[0107] This embodiment provides an intelligent hairstyle recommendation device based on neural network and Unity, including: a mapping table construction module, a data set construction module, an image preprocessing module, a classification prediction module, a facial feature analysis module, a hairstyle library construction module, and a hairstyle number Output module, user face 3D model building module, 3D hairstyle recommendation effect display model building module and effect display module;

[0108] In the present embodiment, the mapping table building module is used to collect the mapping relationship between facial features and hairstyle attributes and establish a mapping table between facial features and hairstyle attributes, and split the facial features into multiple two-category indexes;

[0109] In this embodiment, the dataset building module is used to construct a dataset for facial feature extraction;

[0110] In this embodiment, the image preprocessing module i...

Embodiment 3

[0120] like image 3 As shown, this embodiment provides an intelligent hairstyle recommendation system based on neural network and Unity, is provided with the intelligent hairstyle recommendation device based on neural network and Unity of The client communication module and the Android client central control module; the server end is also provided with a Socket server communication module, a database module and a server central control module;

[0121] like Figure 4 As shown in the figure, the neural network model is trained based on facial features, and the intelligent hairstyle recommendation algorithm is implemented. In the overall system framework, the facial feature analysis and hairstyle recommendation process are stored in a Python script, and the UI user interface is an interface that provides user interaction with the client. It is used to receive user pictures and additional requirements, such as "occasion", "age", "style"; the Socket client communication module i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method, device and system for intelligent hairstyle recommendation based on neural network and Unity. The method includes the following steps: establishing a mapping table between facial features and hairstyle attributes; constructing a data set; Perform different preprocessing operations on pictures; train the corresponding neural network to complete the classification and prediction of the corresponding facial features; perform facial feature analysis, and give the attributes of recommended hairstyles according to the mapping table; establish a hairstyle library, and mark the hairstyle attributes for each hairstyle, Retrieve the recommended hairstyle number in the hairstyle library; generate the 3D model of the user's face according to the coordinates of the key points; render the 3D model of the user's face and multiple hairstyles with the specified number to synthesize the 3D hairstyle recommendation effect display model, and receive the user's face picture to preview the hairstyle display effect . The invention realizes the intelligent hairstyle recommendation service for the user, and realizes the display of the trial hair effect in the form of 3D model.

Description

technical field [0001] The present invention relates to the technical field of intelligent hairstyle recommendation, in particular to a method, device and system for intelligent hairstyle recommendation based on neural network and Unity. Background technique [0002] Traditionally, when people think about hairstyles, they mainly look at images, film and television materials, or ask stylists. This is not only time-consuming and labor-intensive, but also the effect may not be ideal, and even the problem that the shape is destroyed and cannot be restored. On the other hand, socially phobic people are also reluctant to accept traditional methods because they are not comfortable communicating with stylists or are resistant to trying different looks in public. The preview and selection of personal styling effects through the mobile phone software allows users to freely choose the preview effects, which is convenient and does not need to bear the risk of the original styling being ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/53G06V40/16G06K9/62G06N3/04G06N3/08G06V10/774G06V10/764
CPCG06F16/53G06N3/08G06V40/168G06V40/172G06N3/045G06F18/241G06F18/214
Inventor 唐杰宋弘健帖千枫肖鸿昭黄翊琳薛又天
Owner SOUTH CHINA UNIV OF TECH