446 results about "Forgery detection" patented technology

The invention provides a multi-image forgery detection method and system based on a cross-modal vision large language model, and relates to the technical field of image processing and computer vision, and the method comprises the steps: constructing a data set, and carrying out the preprocessing of the data set; according to the preprocessed data, respectively extracting visual features and language features through a pre-trained visual Transform and a language model so as to obtain cross-modal features; according to the cross-modal features, the visual features and the language features are clustered, cross-modal similarity is calculated, a matching relation is established, fusion is carried out, and fused multi-modal features are obtained; and according to the fused multi-modal features, performing adversarial training through a generator and a discriminator to generate an adversarial network. According to the method, high-precision detection and effective detection of multiple image counterfeiting types such as positioning splicing, copying and pasting, AIGC generation and the like are realized.

The invention discloses a deep counterfeiting detection model training method, a deep counterfeiting detection method and a deep counterfeiting detection system, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining a training data set containing a real image and a plurality of counterfeit images, and enabling the image to be provided with a label for representing the authenticity; in the training process, the deep forgery detection model can be in contact with various types of image samples, so that wider and more complex image features and forgery modes can be learned, a forgery reason is further marked for a forgery image, and the deep forgery detection model can be helped to deeply understand essential features of forgery content in the training process. Therefore, the problem of insufficient detection capability for well-designed and high-quality counterfeited contents can be solved, and the technical effect of improving the accuracy of counterfeited detection is achieved.

The invention discloses a deep forgery detection method based on a visual language model, and relates to the field of image forensics. The deep forgery detection method based on the visual language model aims to combine multi-source information to improve the discrimination capability of the model on a real image and a generated image. The method comprises the following steps: firstly, extracting image features through an image encoder of a pre-trained CLIP model; meanwhile, a frequency domain enhanced counterfeit perception adapter is embedded in the image encoder to mine potential anomalies of counterfeit images in the image domain and the frequency domain. Secondly, a manual feature extraction module is provided, discriminative low-dimensional features are extracted from the four aspects of the edge, the texture, the frequency and the symmetry of the image, and the discriminative low-dimensional features are used as auxiliary information input in the forgery detection process, so that the robustness and the interpretability of the model are improved; meanwhile, the text cue words are converted into feature vectors through a text encoder of a pre-training CLIP model; and finally, the model predicts a forgery score by calculating the cosine similarity between the image features and the text features so as to realize the discrimination of the authenticity of the image. According to the method, the problem that the detection capability of the model on the cross-dataset is insufficient is effectively improved.

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of financial science and technology, medical health and the like, and discloses an image detection method, device, equipment and medium based on adversarial generation. Performing global feature modeling by adopting an image feature extraction module of a self-attention mechanism, generating a forgery probability graph in combination with a forgery region recognition module, constructing a joint loss function based on a detection loss value and an adversarial loss value, and optimizing model parameters of a generator, the feature extraction module and the recognition module through the joint loss function to obtain a forgery probability graph; and finally, a counterfeit detection model for identifying counterfeit information in the image is formed. According to the method, the diversity of training data is improved through adversarial sample generation, the image feature modeling capability is enhanced through a self-attention mechanism, multi-dimensional loss optimization is realized through fusion of counterfeit region difference information, and the detection precision and robustness of the model to a counterfeit image are improved.

The invention discloses a multi-mode counterfeit video detection method based on a multi-head addition cross attention mechanism, and belongs to the technical field of video counterfeit detection. The method comprises the following steps: preprocessing a video stream, decomposing a single-frame positioning face, and extracting an audio to generate a Mel spectrogram slice; the 3D convolutional network extracts video spatio-temporal features and motion differences, and the filter bank extracts audio features in combination with the residual network; audio features are mapped to a video alignment space through asymmetric projection, the video features are subjected to bidirectional interaction with an audio input multi-head addition cross attention module after being subjected to time sequence coding, and audio dominant and video dominant features are generated and are cascaded and fused with original features; and constructing cross-modal similarity loss constraint feature distribution, and fusing feature dynamic weighting and time sequence compression to output four classification probabilities of audio-visual double true, audio-visual double pseudo, video pseudo-audio true and video pseudo-audio pseudo. The multi-mode counterfeiting recognition precision is improved, and texture abnormity and audio and video mismatch features are captured.

The invention provides a multi-mode depth forgery detection method and device, and the method comprises the steps: obtaining a video frame sequence and an audio sequence of a target source video, carrying out the feature extraction of the video frame sequence based on a preset visual feature extraction model, and obtaining a visual feature, performing feature extraction on the audio sequence based on a pre-trained audio spectrogram coding model to obtain audio features, fusing the visual features and the audio features to obtain corresponding fusion features, obtaining a preset target multi-modal deep counterfeiting detection model, performing counterfeiting identification on the fusion features based on the target multi-modal deep counterfeiting detection model, and obtaining a target multi-modal deep counterfeiting detection model. And determining an identification result of the target source video.

The invention discloses a multi-category image counterfeiting detection method, device and equipment and a medium, and relates to the technical field of image processing, and the method can realize the recognition of a real face, a counterfeited face, a real cartoon face, a counterfeited cartoon face, a real sketch face and a counterfeited sketch face. According to the multi-branch network, through integrating characteristics of pre-training models such as the EfficientNet, the ResNet and the DenseNet, and combining a feature fusion attention layer, the classification capability of complex class images is remarkably improved. In order to construct a high-quality counterfeited sketch data set and realize a counterfeited image generation framework based on CycleGAN, the diversity and robustness of the data set are enhanced by optimizing the generation effect by using adversarial loss, cyclic consistency loss, perception loss and the like. Experimental results show that the provided model shows excellent performance in a multi-category classification task, the average accuracy and the F1 score respectively reach 98.12%, and the model shows excellent generalization ability in classification of real and forged images.

The invention belongs to an image processing technology, and particularly relates to a deep forgery detection method and system based on face embedded difference guidance, and the method comprises the steps: generating a forgery image according to an input real image, and calculating a difference image and a semantic difference vector of two images; learning the features of the real image and the forged image by using a first classifier, and learning the features of the real image and the difference image by using a second classifier; splicing and fusing the semantic difference vector and image features extracted from the difference image through a channel to obtain fused features, and learning the difference between the real face features and the fused features by using a third classifier; and calculating the distillation loss between the fusion feature and the image feature of the forged image, and training in combination with the loss of each classifier. According to the method, multi-level feature fusion, a three-classifier architecture and a knowledge distillation mechanism are adopted, the strong generalization ability across data sets is achieved, and the system can output a high-precision deep forgery judgment result.

The invention relates to an unsupervised face forgery detection method and system based on frequency domain supplementation, and belongs to the technical field of computer vision. The detection method comprises the following steps: inputting a face image to be detected into a reference network based on ResNet, and extracting multi-level coding features through an encoder of a frequency domain enhanced variational auto-encoder; performing frequency domain enhancement processing on the multi-level coding features, generating high-frequency enhancement features, inputting the high-frequency enhancement features to a decoder of the frequency domain enhancement variational auto-encoder, performing feature reconstruction in combination with a dynamic spectrum loss mechanism, and generating reconstructed frequency domain supplementary features; global pooling and local pooling are carried out on the multi-level coding features, global representation and local representation are generated and connected along a channel axis, and fused multi-scale features are generated; calculating an abnormal score graph based on the fused multi-scale features and the reconstructed frequency domain supplementary features; and determining an image authenticity result of the to-be-detected face image according to the pixel-level score of the abnormal score graph. According to the invention, the accuracy of face counterfeiting detection can be improved.

The invention provides a face forgery detection method based on multi-domain clue reconstruction, and the method comprises the following steps: collecting face video data, and extracting face images of an Xi-th frame and an (Xi + n)-th frame; constructing a convolutional neural network model, and initializing parameters of the convolutional neural network model; generating a feature enhanced image by using the face image of the Xi frame and the face image of the Xi + n frame; potential spatial features are generated from the feature enhanced image, a reconstructed image is generated, and multi-scale features of the potential spatial features are extracted; generating fusion features by using the potential spatial features and the multi-scale features; generating a residual image by using the reconstructed image and the (Xi + n) th frame of face image, and generating a global attention feature by using the fusion feature and the residual image; and calculating a loss function, and carrying out face counterfeiting detection to judge whether a counterfeiting trace exists or not. The method provided by the invention can realize accurate detection of the forged image.

The invention discloses a face forgery detection method based on a feature enhancement Mama framework, and relates to the technical field of image processing, and the method is characterized in that the method comprises the following steps: S1, preparing a data set; s2, constructing a Mama framework based on feature enhancement; according to the framework, a local enhancement state space module is introduced on the basis of an original Mama framework, and the module comprises a global feature enhancement module and a local feature enhancement module; s3, training the model; the specific image feature extraction process is as follows: S31, feature extraction of the global feature enhancement module; s32, feature extraction of a local feature enhancement module; s33, fusion features are obtained; and S4, constructing a loss function. The technical problem to be solved by the invention is to provide a face forgery detection method based on a feature enhancement Mama framework, the framework can accurately capture global and local features of an image, a good effect is achieved in complex and changeable face forgery detection, and a forgery face image can be effectively identified.

The invention discloses a face forgery detection algorithm based on style-guided multi-view fusion processing. The method comprises the following steps: firstly, carrying out standardized preprocessing on a face video sample, and extracting multi-scale image features based on an OfficientNet-B4 backbone network; by constructing a local texture map, an attention enhancement map and a style vector sequence, precise modeling and discrimination of a forged area are realized. The algorithm further utilizes a multi-branch sequence convolutional network to carry out time sequence modeling on fusion features, and outputs global style change representation for classification of forged and real images. The method comprehensively fuses the spatial texture, the semantic style and the time feature, has the advantages of high detection precision, strong generalization ability, good robustness and the like, and is suitable for complex and diverse depth forgery detection tasks.

The invention discloses an audio and video depth forgery detection method based on quality perception and multi-scale alignment, and the method comprises the following steps: coding a synchronous audio and video sequence, and obtaining a frame-level visual feature, a facial action unit and a phoneme-level voice representation; a visual quality evaluation module is introduced to generate a spatial reliability mask, and quality weighting is carried out on the visual features; designing a global-local multi-scale cross-modal alignment mechanism, performing bidirectional cross-attention modeling on voice and face dynamic synchronization globally, and performing physiological coupling alignment on phonemes and face action units locally; and an uncertainty perception reasoning and calibration scheme is provided, adaptive temperature scaling is carried out according to quality and consistency, and uncertainty calibration is carried out by self-supervision loss. According to the method, the problems of insufficient robustness and excessive self-confidence misjudgment of an existing method in a low-quality video and high-synchronization counterfeit scene are solved, and the cross-dataset generalization capability and the actual deployment reliability are remarkably improved.

The invention discloses a deeply-forged face video frame-level positioning method and system based on weak supervised learning, and the method comprises the steps: firstly constructing a training set with a video as a unit, carrying out the data enhancement of a frame-level sample, and generating an enhanced view pair; secondly, splicing the enhanced view pair and inputting the spliced enhanced view pair into a depth forgery detection model to obtain and generate fusion enhanced frame-level features; then, intra-class contrast learning loss, time sequence consistency constraint loss and frame weight loss are constructed, and a deep forgery detection model is trained based on fusion-enhanced frame-level feature joint optimization. And finally, inputting a video to be detected into the deep counterfeiting detection model to output the frame-level confidence, judging whether the video is a forged video or not, and realizing frame-level counterfeiting positioning. According to the method, video-level detection and frame-level positioning are effectively realized, meanwhile, the influence of label noise in part of forged videos is relieved, and the generalization and robustness of the system are improved.

The invention discloses an incremental counterfeit face image identification method based on cross-domain feature alignment, which belongs to the field of deep counterfeit detection, and comprises the following steps of: constructing a face image counterfeit detection model, extracting a network by taking Xception as a main feature when the model is constructed, a task adaptive weight correction module, a class awareness supervision comparison learning module, a double knowledge distillation module and a classification discrimination module are synchronously introduced; defining a task sequence, and constructing a task sample set and a task test set for subsequent model training and testing; a domain chain progressive training mechanism is adopted to train the face image forgery detection model, and the training process is composed of a basic stage and a plurality of incremental task stages; after training of each task is finished, testing is carried out; and obtaining a current to-be-identified face image, and inputting the final face image counterfeiting detection model to obtain an identification result. According to the method, the accuracy and generalization of face image counterfeiting detection can be effectively improved.

The invention relates to the technical field of image detection, can be applied to business system platforms of financial science and technology, medical health and the like, and discloses a video content counterfeiting detection method, device, equipment and medium, and the method comprises the steps: obtaining a to-be-detected video stream, carrying out the frame sampling and standardization processing of the to-be-detected video stream, and generating a to-be-detected video sequence; performing visual double-branch feature extraction on the to-be-detected video sequence to obtain a universal visual feature, a local counterfeit feature and an audio feature; fusing the universal visual features, the local counterfeit features and the audio features to obtain audio and video consistency features; mapping the audio and video consistency feature to a low-dimensional decoupling space and carrying out feature decoupling to obtain a target counterfeit feature; and performing expansion convolution on the target counterfeiting feature to obtain a target counterfeiting probability sequence, and determining authenticity of the to-be-detected video stream according to the target counterfeiting probability sequence. According to the invention, the content counterfeiting detection efficiency and detection accuracy can be improved.

The invention provides a face video depth forgery detection method based on face micro-expressions, which comprises the following steps of: 1, extracting face micro-expression actions from a face video to obtain a micro-action time sequence; step 2, performing time sequence consistency learning according to the micro-action time sequence; step 3, based on a GRU network architecture, introducing an attention mechanism, and constructing an authenticity detection model for capturing abnormal features of the micro-action time sequence under a short scale; step 4, training the authenticity detection model; and step 5, carrying out authenticity detection, extracting a human face micro-motion track for a to-be-detected human face video with unknown authenticity, and then detecting time sequence abnormal features by adopting the authenticity detection model trained in the step 4 to obtain a classification result of whether the to-be-detected human face video belongs to a forged video or not. The method is competitive in accuracy and generalization.

The invention relates to a source tracking and forgery detection method and system based on a face semantic mask, and belongs to the technical field of computer vision. The method comprises the following steps: acquiring a to-be-processed image; dividing a face semantic core region and a face semantic non-core region of the to-be-processed image, and generating masks of the face semantic core region and the face semantic non-core region; respectively embedding a detection watermark and a traceability watermark into the human face semantic core area and the human face semantic non-core area through a watermark encoder to obtain an image embedded with the detection watermark and the traceability watermark; processing the image embedded with the traceability watermark and the detection watermark through a noise layer to obtain a noise image; a traceability watermark and a detection watermark are extracted from the noise image through a traceability decoder and a detection decoder respectively, and whether the image is deeply counterfeited or not is judged; and carrying out loss function constraint training. According to the invention, the accuracy of image forgery detection can be improved.

The invention discloses a face forgery detection method and system based on multi-view collaborative fusion, and relates to the technical field of computer vision, and the method comprises the steps: obtaining to-be-detected video frame data; preprocessing the video frame data to be detected to obtain a standardized input image tensor; and inputting the standardized input image tensor into a pre-trained face counterfeiting detection model, and processing the standardized input image tensor by the face counterfeiting detection model to generate a face counterfeiting detection result. According to the method, the technical problem of poor detection performance of the model in cross-library and complex environments is solved, the detection robustness of the model in complex scenes such as fuzzy and compressed scenes is remarkably improved, and the detection precision is remarkably improved.

The invention belongs to the technical field of multimedia security, and particularly relates to a deep forgery detection method and system based on audio and video multi-mode fusion. The method comprises the following steps: extracting lip motion space-time characteristics from a video stream through dynamic ROI (Region of Interest) cutting, and processing an audio stream through fast Fourier transform and a Mel filter bank in sequence to obtain audio spectrum characteristics; reconstructing and generating a corresponding audio feature based on the spatio-temporal feature of lip motion, and fusing the audio spectrum feature and the generated audio feature by adopting a bidirectional cross-modal attention mechanism to obtain an attention fusion feature; a Mel spectrogram of the audio stream is acquired, and feature maps of different scales are extracted from the Mel spectrogram and the video stream by using a feature extraction model formed by a convolutional layer and are fused to obtain multi-scale features; after the attention fusion feature and the multi-scale fusion feature are flattened, performing weighted fusion after channel dimension splicing, and outputting a forgery probability through a multi-layer perceptron. The video detection performance is improved.

The invention discloses a deep counterfeit video detection method fusing ViT and spatial features, belongs to the technical field of video identification, and is used for detecting a deep counterfeit video. The method comprises the following steps: constructing a neural network fusing ViT and spatial features; training a deep counterfeit video detection network; acquiring face data information in the deep forged video; and inputting the processed video information into the trained deep forged video detection network, and outputting whether the video information belongs to a forged video or not. According to the method, the advantages of the convolutional neural network in image counterfeiting detail extraction in video counterfeiting detection are fully utilized, thoughts of orthogonal convolution, an attention mechanism, residual connection and the like are combined, the accuracy of deep counterfeiting video detection is improved while the complexity of the model is maintained, and the detection efficiency of the deep counterfeiting video is improved. And moreover, the method has relatively stable detection performance in videos generated by various counterfeiting technologies.

The invention discloses a fake video detection method and system based on potential space learning, and belongs to the technical field of multimedia forensics, and the method comprises the steps: reinforcing the capturing capability of a model for the potential distribution difference of true and false videos through triple contrast learning, combining GRU network modeling time sequence dynamic features and 3D CNN extraction time-space content features, and obtaining a fake video detection result. The joint representation of video time-space domain features is realized, potential spatial features and content features are dynamically fused through an attention mechanism to focus and forge contradictory information, and a global self-attention mechanism of a time encoder is utilized to mine a long-range time sequence dependency relationship. The method overcomes the problems of insufficient generalization ability, weak time sequence modeling and single feature expression of an existing deep counterfeiting detection method, can effectively distinguish a high-quality counterfeiting video from a real video, improves the adaptability to an unknown counterfeiting technology, enhances the detection robustness of a time sequence anomaly and a complex counterfeiting scene, and improves the detection efficiency. And a solution is provided for deep counterfeiting identification.

The invention relates to the technical field of deep counterfeit image detection, and discloses a deep counterfeit detection method and system, a storage medium and computer equipment. The method comprises the following steps: firstly, constructing a reference data set containing a forged image and an original real image; secondly, through an integrated model, generating antagonistic samples for the reference data set, and integrating the successfully attacked antagonistic samples into an antagonistic sample set; and finally, merging the reference data set and the adversarial sample set, and constructing a robustness enhanced data set containing four types of samples. In the model training stage, multi-classification cross entropy loss and comparative learning loss are combined, and expression of the model in a feature space is optimized through comparative learning constraint, so that the model learns discriminative features with more compact intra-class features and more dispersed inter-class features. The model trained by the method not only can effectively defend against attack and improve robustness, but also surpasses original detection performance on clean samples, and has remarkable technical advantages and application value.

The invention provides a video depth forgery detection method based on space-time inconsistency and frequency domain analysis, the forgery detection method constructs a video depth forgery detection network of an unknown environment image, and the video depth forgery detection network comprises a space-time inconsistency module, a frequency domain analysis module and a video level classifier. The space-time inconsistency module captures space-time features in video frames, through a double-flow cooperation mechanism integrating space-time inconsistency modeling and frequency domain artifact analysis, the space-time features in videos are efficiently captured, dynamic information interaction between key frames is achieved, and therefore an enough feature basis is provided for deep counterfeiting detection. And the frequency domain analysis module combines a deep neural network with time-frequency analysis and maps video frames to a frequency domain so as to realize end-to-end identification of an unknown tampering mode and provide support for understanding of fine-grained content and improvement of classification precision.

The embodiment of the invention provides a counterfeit recognition method and device based on local image understanding, and the method comprises the steps: receiving a to-be-recognized image, extracting the features of a counterfeit region of the to-be-recognized image, generating an abnormal region thermodynamic diagram of a suspicious counterfeit region corresponding to the to-be-recognized image based on the features of the counterfeit region, and carrying out the recognition of the abnormal region thermodynamic diagram. Under the condition that the spatial distribution of the abnormal region thermodynamic diagram is reasonable, generating structured text prompt information according to a preset prompt information format based on the abnormal region thermodynamic diagram and the to-be-recognized image, and encoding the text prompt information and the to-be-recognized image to obtain text embedding features, and activating a target expert model corresponding to the suspicious counterfeit region based on the text embedding feature, and processing the corresponding suspicious counterfeit region through the target expert model to obtain a counterfeit confidence coefficient and a counterfeit recognition result corresponding to each suspicious counterfeit region. According to the method, the defect that local counterfeit information is easy to omit is effectively overcome, and the accuracy of counterfeit identification is remarkably improved.

The invention discloses a deep forgery detection method and system based on frequency domain channel selection and mutual information, and belongs to the technical field of image processing. The method comprises the steps that a face image data set is acquired and preprocessed; constructing a deep forgery detection model and performing training by using the preprocessed face image to obtain a trained deep forgery detection model; and obtaining a face image to be subjected to forgery detection, and obtaining the authenticity of the face image to be subjected to forgery detection by using the trained deep forgery detection model. The method not only improves the detection accuracy of multi-type counterfeit techniques, but also has strong compression resistance and cross-dataset generalization ability, and is suitable for security detection tasks of various complex and multi-source counterfeit contents.

The invention discloses a deep forgery detection method and system based on attention suppression and patch recombination, and the method comprises the following steps: dividing an input image into a plurality of non-overlapping image patches, and obtaining a patch feature sequence in combination with a classification mark; constructing a deep forgery detection model and training the deep forgery detection model; sorting the attention weights, randomly inhibiting the image patches of the first k weights, performing dichotomy authenticity prediction based on the classification mark of the complete image, and storing the original attention weight before inhibition; the patch feature sequence is divided and recombined to form two new patch groups, the two new patch groups are respectively input into a trunk vision Transform network which shares weights but closes an attention suppression module, classification mark features are extracted, and the classification mark features and the classification mark features of a complete image are subjected to comparative learning; and based on the trained trunk vision Transform network, extracting to obtain a deep counterfeiting detection feature. The method has efficient forgery detection performance in a complex and changeable environment.

The invention discloses an image forgery detection method, system and device based on pixel difference perception, and belongs to the technical field of computer vision and artificial intelligence. The method comprises the following steps: S1, acquiring a real image and a forged image, and preprocessing and labeling the real image and the forged image; s2, processing the preprocessed image by using a position exhibition module; s3, performing down-sampling on the image obtained in the step S2, and extracting low-frequency information of the original image; s4, adjusting the size of the original image to be consistent with that of the down-sampled image; s5, performing subtraction on the image obtained by processing in the step S4 and the image sampled in the step S3, and calculating a difference value of adjacent pixels to form a difference value image; s6, performing up-sampling on the difference image, and extracting features; and S7, classifying the extracted features by using a lightweight deep learning network, and outputting a detection result, the method can accurately capture fine counterfeit traces in the image generation process, and significantly improves the accuracy and robustness of image counterfeit detection.

The invention provides a face forgery detection method and system, and the method comprises the steps: determining an image feature sequence of a spatial domain and an image feature sequence of a frequency domain of an input face image of a training set; adopting a preset feature extraction network to determine a first face counterfeiting feature and a second face counterfeiting feature; performing classification prediction by adopting a preset first classification head and a preset second classification head, and determining classification loss; performing comparative learning on the second face counterfeit feature and a preset dynamic memory bank to determine a comparison loss; according to the classification loss and the comparison loss, optimizing a preset feature extraction network, and determining a face forgery detection model; and inputting the actually input face image into the face forgery detection model, and determining the trueness and forgery type of the actually input face image, through the face forgery detection method and apparatus, the spatial domain features and the frequency domain features are fused, the accuracy of face forgery detection is improved, and the robustness and generalization of the face forgery detection model are improved in combination with a classification task and comparative learning.

The invention relates to the technical field of audio forgery detection, in particular to an audio forgery detection method and system based on lightweight federated adversarial training, and the method comprises the steps: a client extracts audio features through a lightweight network, and updates a model through local adversarial training; the server aggregates the client parameters to generate a global model and issues the global model; and the client performs forgery detection by using the global model. According to the method, a federal learning framework is adopted, original audio is not out of the local, only compressed model parameters are uploaded, high-performance collaborative learning under privacy protection is realized, a data island is broken, and the generalization ability is improved; time domain, frequency domain and frequency spectrum residual multi-dimensional features are fused with cross-modal attention, and adversarial disturbance training is introduced locally, so that feature resolution and anti-interference robustness are enhanced; through combination of pruning, quantification and distillation lightweight processing, the communication and calculation overhead is remarkably reduced, and mobile and IoT edge equipment can be efficiently deployed.