Article Purpose Detection via Contextual Word Vectors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for identifying information with specific purposes in articles are slow and labor-intensive, relying on domain knowledge and manpower, making it difficult to quickly determine if information is accurate or has a specific purpose.

Innovation Solution

A device and method that generates contextualized word vectors for sentences in an article using a feature identification model, then inputs these vectors into a specific purpose detecting model to determine if the article has a specific purpose based on distributed representation similarity, reducing manpower load and increasing speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If domain knowledge fields and manpower with recognition capabilities are used to check whether information has specific purposes, then the accuracy of detection is improved, but the checking speed deteriorates

Engineering Contradiction:
Improvedetection accuracyVSAvoidchecking speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces the mechanical system of manual human review with an automated computational system using machine learning models (BERT, RoBERTa, DistilBERT) to detect articles with specific purposes. The system processes articles automatically through neural network architectures, substituting human cognitive work with algorithmic computation, thereby maintaining detection accuracy while dramatically improving checking speed.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If manual recognition by domain knowledge experts is used to identify articles with specific purposes, then the reliability of detection is improved, but the time consumption deteriorates

Engineering Contradiction:
Improvedetection reliabilityVSAvoidtime consumption
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements preliminary action by pre-training machine learning models on large corpora of articles with labeled specific purposes before actual detection. The models (BERT, RoBERTa, DistilBERT) are prepared in advance with learned representations of different article types, enabling rapid and reliable detection without requiring real-time human expert analysis. This pre-computation of detection capabilities reduces both time consumption and maintains reliability.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If automated text processing is used to identify articles with specific purposes, then the productivity is improved, but the measurement precision deteriorates

Engineering Contradiction:
Improvechecking speedVSAvoiddetection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent employs a composite approach by combining multiple machine learning models (BERT, RoBERTa, DistilBERT) with different architectural characteristics to process articles. Each model contributes different strengths to the detection process, creating a composite system that maintains high detection accuracy while achieving fast processing speeds. The ensemble of models compensates for individual weaknesses and amplifies collective strengths.

Inventive Principle:
Principle #40Composite materials

Data Source

PatentUS11386305B2Device and method for detecting purpose of article
Publication Date: 2022.07.12 INSTITUTE FOR INFORMATION INDUSTRY
  • US11386305B2 patent drawing
  • US11386305B2 patent drawing
  • US11386305B2 patent drawing

AI summary

A device and a method for detecting a purpose of an article are provided. The device is configured to divide the article into a plurality of sentences and input the sentences to a feature identification model to generate a contextualized word vector corresponding to each of the sentences. The device further inputs the representation to a specific purpose detecting model to generate a distributed representation similarity of the article. When the distributed representation similarity of the article is greater than a threshold, the device determines that the article conforms to a specific purpose.