Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Blind face restoration method and system

A blind face, least squares technique, applied in the field of image processing, can solve problems such as poor generalization ability, difficult training of curve subnets, and large background differences.

Inactive Publication Date: 2021-04-02
成都东方天呈智能科技有限公司
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the lack of direct monitoring information for guiding images, the curve subnetwork is difficult to train and has poor generalization ability;
[0008] Third, the guidance image and the degraded image are usually taken under different lighting conditions, with large background differences;
[0009] Fourth, cascade-based fusion methods are still limited in terms of complementarity between guidance and degraded images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Blind face restoration method and system
  • Blind face restoration method and system
  • Blind face restoration method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0079] Such as Figure 1 to Figure 2 As shown, this embodiment provides a blind face restoration method and system, wherein the system includes a data preprocessing module, a feature extraction module, a training module and a testing module.

[0080] Specifically: if figure 1 As shown, the data preprocessing module S101 collects the blind face data set VGGFace2, uses the Laplacian gradient to evaluate the quality of the data set, removes blurred and non-face images, and uses random cropping, horizontal flipping and chromaticity transformation (brightness and contrast) to enhance the image data, and set the image size to 256×256, then convert it into the corresponding tfrecord format file, read the data in parallel with multi-threads, and obtain the training and test sets;

[0081] Feature extraction module S102, based on the constructed AFFNet network, extracts high-dimensional image features through the convolutional layer of the network;

[0082] The training module S103 ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a blind face restoration method and system, and the method comprises the steps: collecting a blind face data set, evaluating the quality of the blind face data set through theLaplace gradient, and removing blurred and non-face images; enhancing image data for the blind face data set, and randomly distributing to obtain a training set and a test set; constructing an AFFNetnetwork; inputting the images of the training set into an AFFNet network, training the AFFNet network in combination with a reconstruction loss function, a perception loss function, a style loss function and a resistance loss function, and training and optimizing the AFFNet network by using an SGD optimization algorithm to obtain an optimal blind face restoration model; and inputting the image ofthe test set into the optimal blind face restoration model, and carrying out matching and selection to obtain an image with the highest accuracy as a final retrieval result. According to the scheme, the method has the advantages of being simple in logic, accurate, reliable and the like, and has high practical value and promotional value in the technical field of image processing.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a blind face restoration method and system. Background technique [0002] Blind face restoration as described in this paper is to restore low-quality degraded images (noise, artifacts and blurring and their combinations) into clear high-quality images. In recent years, the acquisition and sharing of face images has made great progress. On the one hand, with the development of image acquisition and display technology, more and more high-quality (HQ) visual media have emerged. On the other hand, degraded images and videos are still prevalent due to the diversity of acquisition devices, environment and object motion. Therefore, how to restore clear high-quality images from these degraded images has always been a valuable research topic in the field of computer vision. [0003] High-quality face images play a very important role in applications such as entertainment, surve...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06T2207/10004G06T2207/20081G06T2207/20084G06T2207/30201G06N3/045G06F18/214G06T5/92G06T5/73
Inventor 闫超卢丽黄俊洁
Owner 成都东方天呈智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products