The application discloses a multimode
fiber speckle physical state sensing and image reconstruction integrated method and
system, relates to the technical field of optical
speckle imaging and
machine learning, constructs a multi-state speckle dataset, and selects a
pilot codebook based on state separability evaluation; in the reasoning stage, the corresponding speckle sequence is obtained by loading the
pilot image, the
state representation vector is obtained through the shared
encoder and the convergence operator, and the curvature and stress category are output; further, the error between the
pilot true value and the current pilot reconstruction output is used to construct an online calibration
signal, only a few step updates are performed on the FiLM parameter generation unit, adaptive compensation of the continuously drifting unknown physical state is realized; at the same time, the
state representation vector is used to perform conditional modulation on the reconstruction decoder, and state-driven image reconstruction is realized; finally, the integration of physical state sensing and image reconstruction is realized. The application can effectively improve the adaptability of the
system to the continuously drifting state, and improve the reconstruction quality and stability under the multi-state condition.