The invention discloses an old and ancient book cover
image retrieval method based on dynamic partitioning and multi-
modal feature fusion, and relates to the technical field of image recognition, old and ancient book cover images are used as query vectors to be input into a retrieval model, and a matched book
list corresponding to old and ancient books is obtained according to the query vectors; the training process of the retrieval model is as follows: performing visual
feature extraction and text
feature extraction on the cover image of the ancient and old book, and partitioning; inputting the blocked visual features and text features into a cross attention mechanism, and generating an original high-dimensional fusion
feature vector including a
layout text structure and image
layout information; performing
subspace decomposition and quantization coding on the original high-dimensional fusion
feature vector by adopting a
product quantization algorithm to obtain a compressed feature piece vector, and constructing an ancient and old book feature
database according to the compressed feature piece vector; taking cover images of the old and ancient books as input query vectors, indexing the old and ancient book
database by adopting a three-level progressive query architecture, and returning a matched book
list; the trainable parameters of the retrieval model are jointly optimized by constructing a total
loss function; according to the retrieval method, multi-level understanding and
digital reconstruction of ancient book covers are achieved, and rapid retrieval is achieved through efficient index construction.