Neural Network Query Tagging for Polysemous Term Disambiguation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current search engines have limitations in understanding natural language queries, particularly in distinguishing between different meanings of the same term in queries, leading to less relevant search results.

Innovation Solution

An enhanced tagging system that combines named entity recognition with three artificial neural networks to provide deeper understanding of natural language queries by generating enhanced tag predictions based on baseline tags, pretrained word embeddings, and contextual embeddings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If named entity recognition is applied to natural language queries, then the search engine can identify basic entities (e.g., company, software), but it cannot distinguish between different meanings of the same term (e.g., 'Acme' as company vs. 'Acme' as software product)

Engineering Contradiction:
Improvequery understanding precisionVSAvoidterm meaning differentiation
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent segments the query understanding task into multiple specialized neural networks, each responsible for specific entity types (e.g., one network for company entities, another for software entities). This segmentation allows each network to specialize in recognizing specific meanings of terms, thereby resolving the ambiguity of polysemous terms like 'Acme' while maintaining high precision in entity recognition.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary layer of entity type predictions between the basic named entity recognition and the final search query understanding. This intermediary layer provides additional contextual information about the specific type of entity being referenced, enabling the system to distinguish between different meanings of the same term by predicting whether 'Acme' refers to a company, software product, or other entity type.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If basic named entity recognition is used, then the system can process queries efficiently, but the search results lack relevance when terms have multiple meanings

Engineering Contradiction:
Improvequery processing efficiencyVSAvoidsearch result relevance
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent divides the query processing system into multiple specialized neural networks that operate in parallel, each trained on specific entity types. This segmentation maintains processing efficiency through parallel computation while improving result relevance by having each network specialize in recognizing specific entity meanings, thereby reliably distinguishing between different interpretations of ambiguous terms.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameters of the recognition system by training separate neural networks with different parameter sets optimized for specific entity types. Each network learns distinct patterns and features relevant to its specialized entity type, enabling the system to maintain high processing efficiency while achieving reliable differentiation between multiple meanings of the same term through parameter specialization.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11593559B2Enhanced natural language query segment tagging
Publication Date: 2023.02.28 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11593559B2 patent drawing
  • US11593559B2 patent drawing
  • US11593559B2 patent drawing

AI summary

Computer-implemented techniques for enhanced tagging of natural language queries that are initially segmented and tagged by a named entity recognition system. By doing so, enhanced tagging of a natural language query that represents a deeper understanding of the query is provided. The enhanced tagging improves the operation of search engines that use the enhanced tags by enabling the search engine to identify and return more relevant search results in answers to natural language queries.