Metaphor Detection Encoder Using GCN and BiLSTM
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current natural language processing systems face challenges in accurately detecting metaphorical expressions due to the complexity of distinguishing literary and non-literary meanings, which affects text comprehension and tasks like information extraction and machine translation.
Innovation Solution
A system utilizing a graph convolutional neural network (GCN) module to encode links between target and core words, combined with a control module for regulating representation vectors, and a multi-task learning module for knowledge transfer between Word Sense Disambiguation and Metaphor Detection tasks, employing BiLSTM and feed-forward neural networks for high-accuracy metaphor detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If rule-based learning systems or machine learning systems are used for metaphor detection, then the system can detect metaphorical expressions, but the accuracy is insufficient due to difficulty in distinguishing literary and non-literary meanings
Solution Approach 1:
The patent segments the metaphor detection task into multiple components: word embedding layer, BiLSTM layer for contextual representation, attention mechanism for feature weighting, and classification layer. This segmentation allows each component to specialize in specific aspects of meaning analysis, improving overall detection accuracy and reliability in distinguishing literary from non-literary meanings.
Solution Approach 2:
The patent introduces attention mechanisms that add a new dimension to the analysis by dynamically weighting different features and contextual information. The attention layer computes attention scores that highlight relevant features for metaphor detection, enabling the system to focus on discriminative patterns that distinguish literary from non-literary meanings beyond traditional feature spaces.
2Measurement precision
If deep learning techniques are applied to metaphor detection, then detection capability is improved, but the system complexity increases
Solution Approach 1:
The patent merges multiple effective components into a unified deep learning architecture: word embeddings are combined with BiLSTM for contextual representation, which is then integrated with attention mechanisms and classification layers. This merging creates a cohesive system where each component reinforces the others, achieving high detection accuracy while managing complexity through unified design rather than separate processing stages.
Solution Approach 2:
The BiLSTM layer serves multiple functions simultaneously: it captures contextual information from surrounding words, models sequential dependencies in the text, and provides rich feature representations for the attention mechanism. This multi-functionality reduces the need for separate specialized components, thereby improving detection accuracy without proportionally increasing system complexity.
3Productivity
If traditional encoding methods are used, then the processing speed is maintained, but the text comprehension ability is insufficient for metaphor detection
Solution Approach 1:
The patent applies preliminary action by using pre-trained word embeddings (such as GloVe or Word2Vec) that capture semantic relationships before the main processing. This preliminary encoding provides rich initial representations that accelerate subsequent processing while enabling sophisticated metaphor detection, as the model starts with already-computed semantic knowledge rather than learning from scratch.
Solution Approach 2:
The BiLSTM layer acts as an intermediary between simple word embeddings and the classification layer. It transforms static word vectors into dynamic contextual representations by processing sequences bidirectionally, capturing both left and right context for each word. This intermediary processing enhances text comprehension accuracy for metaphor detection while maintaining efficient processing through optimized recurrent computations.
Data Source
AI summary
Provided is an encoder, system and method for metaphor detection in natural language processing. The system comprises an encoding module configured to convert words included in a sentence into BiLSTM representation vectors; a first encoder configured to generate a first entire representation vector of a WSD resolving task; a second encoder configured to generate a second entire representation vector of an MD task; and a multi-task learning module configured to perform knowledge transfer between the first and second encoders. Wherein, each of the first and second encoders includes a graph convolutional neural network (GCN) module configured to encode a link between a target word and a core word to generate GCN representation vectors; a control module configured to regulate the GCN representation vectors to generate an entire representation vector.


