Metaphor Detection Encoder Using GCN and BiLSTM

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current natural language processing systems face challenges in accurately detecting metaphorical expressions due to the complexity of distinguishing literary and non-literary meanings, which affects text comprehension and tasks like information extraction and machine translation.

Innovation Solution

A system utilizing a graph convolutional neural network (GCN) module to encode links between target and core words, combined with a control module for regulating representation vectors, and a multi-task learning module for knowledge transfer between Word Sense Disambiguation and Metaphor Detection tasks, employing BiLSTM and feed-forward neural networks for high-accuracy metaphor detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If rule-based learning systems or machine learning systems are used for metaphor detection, then the system can detect metaphorical expressions, but the accuracy is insufficient due to difficulty in distinguishing literary and non-literary meanings

Engineering Contradiction:
Improvemetaphor detection accuracyVSAvoiddistinction reliability between literary and non-literary meanings
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the metaphor detection task into multiple components: word embedding layer, BiLSTM layer for contextual representation, attention mechanism for feature weighting, and classification layer. This segmentation allows each component to specialize in specific aspects of meaning analysis, improving overall detection accuracy and reliability in distinguishing literary from non-literary meanings.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces attention mechanisms that add a new dimension to the analysis by dynamically weighting different features and contextual information. The attention layer computes attention scores that highlight relevant features for metaphor detection, enabling the system to focus on discriminative patterns that distinguish literary from non-literary meanings beyond traditional feature spaces.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If deep learning techniques are applied to metaphor detection, then detection capability is improved, but the system complexity increases

Engineering Contradiction:
Improvemetaphor detection accuracyVSAvoidsystem architecture complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges multiple effective components into a unified deep learning architecture: word embeddings are combined with BiLSTM for contextual representation, which is then integrated with attention mechanisms and classification layers. This merging creates a cohesive system where each component reinforces the others, achieving high detection accuracy while managing complexity through unified design rather than separate processing stages.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The BiLSTM layer serves multiple functions simultaneously: it captures contextual information from surrounding words, models sequential dependencies in the text, and provides rich feature representations for the attention mechanism. This multi-functionality reduces the need for separate specialized components, thereby improving detection accuracy without proportionally increasing system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If traditional encoding methods are used, then the processing speed is maintained, but the text comprehension ability is insufficient for metaphor detection

Engineering Contradiction:
Improvetext processing speedVSAvoidtext comprehension accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by using pre-trained word embeddings (such as GloVe or Word2Vec) that capture semantic relationships before the main processing. This preliminary encoding provides rich initial representations that accelerate subsequent processing while enabling sophisticated metaphor detection, as the model starts with already-computed semantic knowledge rather than learning from scratch.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The BiLSTM layer acts as an intermediary between simple word embeddings and the classification layer. It transforms static word vectors into dynamic contextual representations by processing sequences bidirectionally, capturing both left and right context for each word. This intermediary processing enhances text comprehension accuracy for metaphor detection while maintaining efficient processing through optimized recurrent computations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11625540B2Encoder, system and method for metaphor detection in natural language processing
Publication Date: 2023.04.11 VINAI ARTIFICIAL INTELLIGENCE APPL & RES JOINT CO
  • US11625540B2 patent drawing
  • US11625540B2 patent drawing
  • US11625540B2 patent drawing

AI summary

Provided is an encoder, system and method for metaphor detection in natural language processing. The system comprises an encoding module configured to convert words included in a sentence into BiLSTM representation vectors; a first encoder configured to generate a first entire representation vector of a WSD resolving task; a second encoder configured to generate a second entire representation vector of an MD task; and a multi-task learning module configured to perform knowledge transfer between the first and second encoders. Wherein, each of the first and second encoders includes a graph convolutional neural network (GCN) module configured to encode a link between a target word and a core word to generate GCN representation vectors; a control module configured to regulate the GCN representation vectors to generate an entire representation vector.