Method and device for automatically adding and deleting portrait objects based on dichotomy labels
A binary classification and object technology, applied in the field of computer vision, can solve cumbersome problems and achieve the effect of high convenience and low network training cost
Pending Publication Date: 2021-11-23
TSINGHUA UNIV
View PDF0 Cites 1 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
These operations are not only cumbersome, but also often require users to have a high professional level to edit high-quality portraits
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
specific Embodiment approach
[0079] Such as figure 2 As shown, the portrait in this implementation example is a 256x256x3 color image, and the addition and deletion of glasses is taken as an example. Since it involves the training and use of the neural network, the following steps are divided into training steps and usage steps.
[0080] Training step 1: Prepare a group of face images without glasses (denoted as A) and a group of face images with glasses (denoted as B)
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a method and device for automatically adding and deleting a portrait object based on a dichotomy tag, and the method comprises the steps: receiving an automatic adding and deleting request of the portrait object, and determining the type of at least one portrait object included in the automatic adding and deleting request of the portrait object; obtaining at least one face image to be modified and at least one reference face image; carrying out feature point detection on the face image to be modified and the reference face image; determining dichotomy labels of the to-be-modified face image and the reference face image for the type of portrait object through an addition and deletion module of the type of portrait object in a pre-trained neural network; and determining a target portrait object addition and deletion mode of the modified face image according to the portrait object features of the to-be-modified face image and the reference face image, and modifying the to-be-modified face image according to the target portrait object addition and deletion mode. According to the method provided by the invention, the corresponding portrait objects can be automatically added and deleted, the convenience is high, and the training cost is low.
Description
technical field [0001] The invention relates to the technical field of computer vision, in particular to a network method for adding and deleting portrait objects by using only binary classification labels. Background technique [0002] Portrait editing is an important application of computer vision. At present, people have a higher demand for the convenience of portrait photo editing. In related technologies, portrait editing is usually performed through an automatic method based on deep learning or a general image editing method. [0003] But most automated methods based on deep learning rely heavily on supervised data. For example, if you want to train a network that adds and deletes glasses, you may need to manually provide the semantic segmentation results of glasses as supervised data. Such supervised data requires a large amount of manual annotation, resulting in high training costs. [0004] Although general-purpose image editing methods (such as image editing sof...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06T3/00G06T11/60G06K9/00G06K9/34G06N3/08
CPCG06T11/60G06N3/08G06T3/04
Inventor 徐枫吕军锋
Owner TSINGHUA UNIV



