Deep learning model training method for fine portrait picture segmentation

A technology of deep learning and image segmentation, applied in neural learning methods, image analysis, biological neural network models, etc., can solve problems such as time-consuming, cost cannot be realized on a large scale, and edge accuracy cannot be met, and achieve cost-saving effects

Inactive Publication Date: 2020-08-25
ZHEJIANG UNIV +1
View PDF2 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the previous algorithm cannot meet the occasions that require high edge precision.
Considering that the deep learning-based model has very high requirements for training and labeling, it is time-consuming to label high-precision portrait edge details such as hair strands and clothes edges
High-precision portrait training samples are often limited by cost and cannot be realized on a large scale

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep learning model training method for fine portrait picture segmentation
  • Deep learning model training method for fine portrait picture segmentation
  • Deep learning model training method for fine portrait picture segmentation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.

[0053] The embodiment process implemented according to the complete method of the content of the present invention is as follows:

[0054] 1) Collect and acquire portrait pictures, with the portrait as the foreground, the foreground area in the portrait picture has been marked as 1, and the background area has been marked as 0, forming a binary portrait / background annotation map, such as figure 1 As shown, constitute the training data set;

[0055] 2) Use the Canny edge algorithm to detect the boundary between the portrait and the background on the binarized portrait / background annotation map;

[0056] 3) Use the adaptive expansion operator to expand the boundary result obtained in step 2) to form the edge area, and obtain the portrait edge / background area annotation map M bound ,Such as figure 2 As shown, in the portrait edge / bac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a deep learning model training method for fine portrait picture segmentation. The method comprises: collecting and obtaining portrait pictures, and performing binaryzation to form a training data set; detecting a boundary by using a Canny edge algorithm; expanding the boundary by adopting an adaptive expansion operator to form an edge region, and obtaining a portrait edge/background region annotation graph; and inputting the original image into a deep learning model for training processing, calculating image gradient loss and segmentation cross entropy loss according tothe portrait edge/background region annotation graph in the training processing, and jointly performing training optimization on the deep learning model. According to the method, a rough manual annotation result is used, a segmentation result which is more accurate than manual annotation is trained in a self-supervision mode, the manual annotation cost is greatly saved, and the method can be applied to various scenes such as personnel monitoring, portrait analysis and portrait editing.

Description

technical field [0001] The invention relates to a training method for fine portrait segmentation, in particular to an image gradient loss function based on the image gradient consistency between an original image and a segmentation prediction result map and a training method thereof. Background technique [0002] Portrait segmentation algorithms are widely used in various fields such as video surveillance, portrait analysis, and portrait editing. However, the previous algorithm cannot meet the occasions that require high edge precision. Considering that the deep learning-based model has very high requirements for training and labeling, it is very time-consuming to label high-precision portrait edge details such as hair strands and clothes edges. High-precision portrait training samples are often limited by cost and cannot be realized on a large scale. Therefore, it is of great practical significance to explore training methods that do not rely on high-precision manual labe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/13G06T5/30G06T7/194G06N3/04G06N3/08
CPCG06T7/13G06T5/30G06T7/194G06N3/08G06T2207/20081G06T2207/20084G06T2207/30201G06N3/045
Inventor 齐冬莲陈汐闫云凤郑伊徐文渊张建良
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products