The invention discloses a multi-
modal named entity recognition method based on multi-
granularity feature enhancement, which comprises the following steps of: firstly, carrying out single-
modal feature extraction on input data, and then carrying out multi-
modal multi-
granularity feature interaction on the input data based on a single-modal
feature extraction result; and finally, performing
label prediction of the input data based on a multi-
granularity feature interaction result to complete entity identification. According to the scheme, a multi-modal
named entity recognition framework capable of being used for
multimedia image-text posts is defined, the single-modal
feature extraction firstly reduces the influence of the result of irrelevant interference of texts and images, the performance of
processing informal and short text contents is achieved, the problem of sparse and
noisy data is effectively solved, and the recognition efficiency of the multi-modal named entities is improved. The multi-modal multi-granularity semantic interaction fully considers the correlation between the text and the picture and the local and overall necessity of the picture feature, more comprehensive
visual guidance required by the text is obtained, the accuracy of final
label prediction is improved, and the experiment has a good experiment result on a witter
data set and has certain popularization and practical values.