Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

False face video detection method and system based on face cross-parallel ratio under trust mechanism

A video detection and face technology, applied in computer components, image data processing, instruments, etc., can solve the problems of decreased accuracy and insufficient generalization ability

Active Publication Date: 2020-03-27
SOUTH CHINA UNIV OF TECH
View PDF2 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The above method can identify fake face videos to a certain extent, especially in the library, and the test can achieve a high accuracy rate. However, the accuracy rate drops sharply in the cross-database test, that is, there is a problem of insufficient generalization ability.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • False face video detection method and system based on face cross-parallel ratio under trust mechanism
  • False face video detection method and system based on face cross-parallel ratio under trust mechanism
  • False face video detection method and system based on face cross-parallel ratio under trust mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0094] Such as figure 1As shown, the present embodiment provides a false face video detection method based on the cross-merging ratio of faces under the trust mechanism, including a network training step and a sample testing step, wherein the network training step includes a model training step and a model verification step;

[0095] In this embodiment, training is carried out on the FaceForensics++ (FF++) database, the in-store test is carried out on the FF++ database, and the cross-database test is carried out on the TIMIT database as examples, and the implementation process of this example is introduced in detail. The experiment is carried out on the Ubuntu16.04 system. Python language version 3.6 and Keras artificial neural network library version 2.2.4, Keras backend is Tensorflow version 1.12.0, CUDA version is 9.0.0, and cudnn version is 7.1.4.

[0096] First, divide the FF++ database and TIMIT data into training set, verification set and test set at a ratio of 7:2:1, a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a false face video detection method and system based on a face intersection ratio under a trust mechanism. The method comprises a network training step and a sample testing step, wherein the network training step comprises model training and model verification. In the model training step, a segmentation network is trained, and a segmentation network model and a weight valueare stored; in the model verification step, a trained segmentation network is used to predict a mask, and a binarization threshold and a decision threshold are determined by using a grid search method, wherein the sample test comprises the steps of performing video framing preprocessing to obtain an input picture, determining a to-be-detected area by utilizing a segmentation network, performing smooth denoising, binarizing the to-be-detected area, determining a face area and an undetermined tampered area, calculating an intersection ratio of the face area and the undetermined tampered area under a trust mechanism, and finally performing true and false face judgment according to a judgment threshold value. The false face video generated by the deep face changing tool is detected, high accuracy is obtained in different databases, the cross-database test performance is obviously improved, and an effective way is provided for false face video detection.

Description

technical field [0001] The invention relates to the technical field of tampering detection of digital video, in particular to a fake face video detection method and system based on facial cross-merge ratio under a trust mechanism. Background technique [0002] Among the many biological features, the human face is one of the most representative features, with a high degree of recognizability. Therefore, with the rapid development of face recognition technology, the security threat brought by face tampering is increasing, especially in the contemporary era when mobile phones are highly popular and social networks are becoming more and more mature. Deep face swapping tools mainly use deep neural networks such as autoencoders or adversarial generative networks to generate fake faces and then replace the faces of the original video. According to the features used, existing fake face video detection technologies can be roughly divided into three types: Major categories: based on ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/38G06K9/40G06K9/62G06T7/00G06T7/11
CPCG06T7/0002G06T7/11G06T2207/10016G06T2207/30201G06T2207/20081G06T2207/20084G06V40/161G06V20/41G06V20/46G06V10/28G06V10/30G06F18/241G06F18/214
Inventor 胡永健高逸飞刘琲贝王宇飞
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products