The invention relates to the technical field of
structure health monitoring, in particular to a
wharf structure state judgment method based on
time sequence image and vibration
data collaboration, which comprises the following steps: synchronously acquiring a
time sequence image set and a vibration
signal set of a
wharf structure, and generating an original double-
source data set with time-space alignment; respectively extracting a structure displacement sequence and a vibration mode parameter set through sub-pixel displacement tracking and
variational mode decomposition; fusing the two to construct a spatial-temporal
characteristic matrix, introducing a temperature field and a
water level height to construct an environmental interference compensation factor, performing characteristic enhancement and
standardization processing, and outputting a damage sensitive matrix; constructing a
hybrid discrimination model by using a physical mechanism constraint layer fusing a structural mechanical
control equation and a
deep learning classification layer formed by one-dimensional
convolution-LSTM, and outputting a structural damage probability value; the method has the advantages of space-time cooperative sensing, environmental interference robustness, high damage discrimination precision, high result
interpretability and the like, and is suitable for real-time monitoring and damage identification of a
wharf structure in a complex marine environment.