Unlock instant, AI-driven research and patent intelligence for your innovation.

Face privacy protection method based on generative adversarial network

A privacy-preserving and generative technology, applied in biological neural network models, neural learning methods, digital data protection, etc., can solve problems such as unrealistic image quality, a lot of time and cost for tagging and training networks, and model inability to converge

Active Publication Date: 2021-05-25
GUIZHOU UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But studies have shown that pixelation and blurring do not ensure the effectiveness of correct face de-identification
[0004] In recent years, neural networks can be used for privacy de-identification, however, methods based on convolutional neural networks (CNN) have two limitations: 1) The quality of generated images is not realistic enough
Therefore, it needs some labels to train the network, but it takes a lot of time and cost
[0005] At present, Generative Adversarial Networks (GAN) provide a new direction for privacy de-identification, however, the facial features of the images generated by this method are not obvious, and the value of the image cannot be preserved effectively
There are three limitations of GAN-based privacy de-identification techniques: 1) Most GAN-based privacy de-identification methods are semi-supervised algorithms that require a small number of labels, but labeling training networks requires a lot of time and cost
2) In the confrontation training of GAN, the generator and the discriminator can easily lead to the risk of mode collapse, overfitting and model failure; 3) The quality of the image generated by this algorithm is not realistic enough, and in the process of de-identification Does not preserve image properties

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face privacy protection method based on generative adversarial network
  • Face privacy protection method based on generative adversarial network
  • Face privacy protection method based on generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0137] 1 data set

[0138] We validate the performance of FPGAN on four public datasets.

[0139] (1) CelebA dataset. The CelebA dataset contains 10,177 identities, 202,599 facial images, 5 landmark locations, and 40 binary attribute annotations per image. We selected 1,700 neutral images and 1,700 smiling images as training data, and 200 neutral images and 200 smiling images as testing data.

[0140](2) MORPH data set. This dataset contains 55,000 face images of more than 13,000 individuals with different demographic characteristics (age, gender, and 53 races). Here, we only use male data because of the limited number of female subjects. We used 1,700 long-haired man images and 1,700 short-haired man images in the MORTH dataset as training data, and 200 long-haired images and 200 short-haired images as test data.

[0141] (3) RaFD dataset. This dataset was released in 2010. Contains 8040 images with 8 facial expressions: Anger, Disgust, Fear, Joy, Sadness, Surprise, Co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The face privacy protection method based on generative confrontation network of the present invention is characterized in that: the face de-recognition method based on generative confrontation network is respectively loaded in the workstation and the robot platform, and the feature model is trained on the workstation W ; When the camera on the robot platform captures the face image, for the face image that needs privacy protection, the robot platform applies the face recognition method based on the generative confrontation network to perform face de-identification, protect the privacy features of the face image, and ensure that the user visual privacy is not violated. The face recognition method based on generation confrontation network includes a generator for improving U-Net network G and 2 discriminators D 1 , D 2 , where the discriminator and generator consist of convolutional layers, residual blocks and self-attention layers. The invention has the characteristics of being able to reduce or eliminate the problems of model collapse and overfitting in the training process, improve the quality of generated images, and visually protect the privacy of images.

Description

technical field [0001] The invention relates to the field of information security protection, in particular to a face privacy protection method based on a generative confrontation network. Background technique [0002] In recent years, a large number of photos and videos have been recorded, stored and processed with the widespread use of mobile phones, tablet computers and other imaging devices. Although these visual devices bring convenience to people, unprotected images or videos will lead to privacy leaks and pose serious challenges to privacy protection. Face de-recognition is an important first step in visual privacy protection, so the problem of face de-recognition has received a lot of attention recently. To preserve visual face privacy, many researchers make the modified face images ineffective for face recognition methods by replacing or changing face regions in the images. [0003] Traditional face de-recognition methods mainly focus on removing identities from i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06F21/62G06N3/04G06N3/08G06K9/62
CPCG06F21/6245G06N3/08G06V40/172G06N3/045G06F18/214
Inventor 杨观赐林家丞李杨何玲蒋亚汶袁庆霓
Owner GUIZHOU UNIV