AI face-changing video detection method based on multi-task learning model

A multi-task learning and video detection technology, applied in neural learning methods, biological neural network models, character and pattern recognition, etc., can solve the problem of inefficient and accurate AI face-changing video detection, inability to efficiently and accurately detect face-changing videos, Poor detection performance and other issues

Active Publication Date: 2020-11-17
CHONGQING UNIV OF POSTS & TELECOMM
View PDF7 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the current public AI face-changing video detection, it is only detected from a single feature, such as based on blinking, mouth shape, and skin edge, resulting in poor detection performance
In the calculation process, most detection methods consider the entire image for calculation, which greatly increases the calculation cost, so that it cannot detect face-changing videos efficiently and accurately.
[0004] The present invention mainly proposes a multi-task learning model to solve the problem that AI face-changing video detection cannot be efficient and accurate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • AI face-changing video detection method based on multi-task learning model
  • AI face-changing video detection method based on multi-task learning model
  • AI face-changing video detection method based on multi-task learning model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The technical solutions in the embodiments of the present invention will be described clearly and in detail below with reference to the drawings in the embodiments of the present invention. The described embodiments are only some of the embodiments of the invention.

[0034] The technical scheme that the present invention solves the problems of the technologies described above is:

[0035] like figure 1 As shown in , pre-download the algorithm for fake video generation, use its own data to generate fake videos and unmodified videos, which are divided into training set, verification set and test set;

[0036] The algorithm used for false video generation is DeepFake, Face2Face and FaceSwap related open source algorithms, the data set comes from open source FaceForensics and FaceForensics++, the number of false videos used is 3000, and the unmodified video is 1000, each of which The data set is divided into 720 videos for training, 140 videos for verification, and 140 f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an AI face-changing video detection method based on a multi-task learning model, which belongs to the field of computer vision and deep learning, and comprises the following steps: pre-training a model based on multi-task learning to detect a modified face-changing video, and positioning a modified area for each query, the model is an automatic encoder and comprises a Y-shaped automatic decoder. A semi-supervised learning method is used for improving the generality of the network, valuable information is shared before multiple tasks, the sum of an activation loss function, a segmentation loss function and a reconstruction loss function is reduced, and an optimizer is used for optimization, so that the performance is improved. And for video input detection, averaging is performed on the probabilities of all frames to obtain the probability that the input is true or false. According to the method, AI face-changing video detection can be improved.

Description

technical field [0001] The invention belongs to the field of computer vision and deep learning, and in particular relates to a false video detection method based on computer and deep learning algorithms, which is used to quickly and accurately determine falsely generated video files and locate video tampered parts. Background technique [0002] With the development of deep learning, there are more and more AI face-changing technologies, the technology is becoming more and more mature, and the effect of AI face-changing is getting better and better. With the development of AI face-changing technology, it has also brought many negative impact. For example, many people with malicious intentions use these technologies to change the faces of celebrities to pornographic pictures and videos, or change the faces of some politicians to videos with bad remarks shot by criminals, trying to shake the world Relationships, such as speeches by the President of the United States, the Presi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/34G06K9/62G06N3/08
CPCG06N3/08G06V40/172G06V40/168G06V20/44G06V20/49G06V20/46G06V20/40G06V10/267G06F18/214
Inventor 李红波王桔波吴渝王艺蓓
Owner CHONGQING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products