The method comprises the following steps: taking an image and a text as input, combining a low-level high-resolution image and a high-level strong-semantic image to enhance image features by using a feature
pyramid bidirectional fusion strategy, extracting
phrase-level features of the text through a
convolutional neural network, and extracting a multi-
modal entity link of the visual and text feature enhancement; the method comprises the following steps: firstly, extracting a visual vector, fusing the visual vector with text character-level features obtained by an
encoder to form text input, filtering
noise embedded in the vector by utilizing a
bottleneck fusion network, improving the fusion efficiency of a model, and fusing the text vector and the visual vector to form a multi-
modal fusion vector; and finally, the entity mentions are linked to the candidate entity with the highest
score in the
knowledge base based on the matching scores. According to the method,
noise of text vectors and image vectors of an existing model can be effectively reduced, key information such as text features and visual features is reserved, feature dimensions are aligned, a
semantic gap between the text vectors and the image vectors is made up, subsequent multi-
modal fusion is facilitated, and the overall performance of
entity linking is improved.