The invention relates to an
efficacy word extraction
system and method based on multi-
modal adaptive learning. According to the
system, multi-
modal data such as texts, images and audios are received through the input module, and
feature fusion is carried out through the preprocessing module. A
hybrid encoder module is utilized, local n-
gram features are firstly extracted through a
convolutional neural network layer, then global context information is extracted through a Transform
encoder, the comprehensiveness of feature representation is guaranteed through a cooperation mechanism, and the limitation of a traditional
single model in the aspect of feature representation precision is overcome. And then, the knowledge
distillation module optimizes the text
semantic representation data to generate efficient lightweight
semantic representation information. The decoder module integrates a vocabulary
library, adopts a strategy of combining generation and
copying, and utilizes the thought of a pointer-generation network, so that the problem of unregistered words is effectively solved, the coverage rate and accuracy are ensured while generalization is kept, and efficient, accurate and robust
efficacy word extraction is realized.