The application discloses a complex
layout document image tamper detection method and
system, and relates to the technical field of
image processing and
computer vision. Aiming at the multi-scale tamper detection problem of complex
layout personnel file images, a credible
layout analysis network is proposed. The network first extracts pixel
gradient direction distribution features as multi-view inputs by using a
differential operator through an image detail feature enhancement module; then, with the help of a twin
encoder, multi-level features of visual layout and gradient distribution are extracted through a multi-scale attention mechanism; then, after passing through a multi-level dual-flow fusion module, heterogeneous
modal features are deeply fused, and global context modeling decoding is completed in combination with a
matrix decomposition mechanism; finally, a tamper detection head outputs a fine-grained multi-class
mask, realizes joint optimization of layout element recognition and tamper state discrimination, and improves the accuracy and robustness of detection with the mutual constraint of the two. The application significantly improves the multi-scale tamper detection precision, and simultaneously has excellent layout analysis performance and running efficiency.