Search System Clustering Emerging Concepts

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing search engines fail to prioritize and present emerging concepts in search results due to their reliance on popularity, linkages, and public discourse acceptance, often neglecting new ideas until they trend or are explicitly queried.

Innovation Solution

An emerging concepts search system that aggregates network-accessible content, uses natural language processing and clustering techniques to identify and link emerging concepts with established ones, presenting relevant entities and content related to emerging concepts in response to queries about established concepts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If search engines prioritize content based on popularity, linkages, and public discourse acceptance, then search reliability and relevance are improved, but emerging concepts are neglected and not presented in search results

Engineering Contradiction:

Improvesearch result relevanceVSAvoidability to present emerging concepts

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system performs preliminary identification and classification of emerging concepts before they gain widespread popularity. By proactively detecting nascent concepts through semantic analysis and clustering of content metadata, the system prepares search results in advance so that when users query related terms, emerging concepts are already positioned for presentation alongside established concepts.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary layer between traditional search query processing and result presentation. This intermediary component analyzes semantic relationships between query terms and both established and emerging concepts, using vector space models and clustering to bridge the gap between popular content and novel ideas, allowing emerging concepts to be presented without requiring explicit user awareness.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If search engines require explicit reference to search query terms, then measurement precision is improved, but emerging concepts that lack established terminology are not identified

Engineering Contradiction:

Improvequery term matching accuracyVSAvoidemerging concept discovery

Core Design Contradiction:

Measurement precisionVSLoss of information

Solution Approach 1:

The system replaces traditional mechanical keyword matching with semantic analysis using vector space models and natural language processing. Instead of requiring exact term matches, the system analyzes the semantic meaning and contextual relationships between query terms and content, enabling detection of emerging concepts through their conceptual relationships rather than requiring established terminology or explicit query term references.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the parameter of concept identification from exact term matching to semantic similarity measurement. By transforming the search parameter from discrete keyword presence to continuous semantic distance in vector space, the system can identify emerging concepts based on their conceptual proximity to query terms even when using different or novel terminology.

Inventive Principle:

Principle #35Parameter changes

3Ease of operation

If search engines focus on widely accepted content, then ease of operation is improved, but discovery of novel ideas and technologies is reduced

Engineering Contradiction:

Improvesearch result accessibilityVSAvoidnovel idea discovery rate

Core Design Contradiction:

Ease of operationVSProductivity

Solution Approach 1:

The system applies local quality by presenting different types of content in different positions and contexts within search results. Established concepts are presented in traditional positions for ease of access, while emerging concepts are highlighted in specialized sections or positioned strategically to maintain visibility without compromising the overall accessibility and usability of the search interface.

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS20230267139A1Systems and Methods to Optimize Search for Emerging Concepts

Publication Date: 2023.08.24 PEAKSPAN CAPITAL MANAGEMENT LLC

AI summary

Disclosed is a system and associated methods to optimize search in order to present emerging concepts that relate to a query for an established concept. The system extracts phrases from different content, generates a first cluster with a first set of phrases that contain a first common set of words and a second cluster with a second set of phrases that contain a second common set of words. The system clusters the first cluster and the second cluster to a cluster group based on a related word amongst the first and second set of phrases. The system receives a query for a particular word in the first common set of words, selects the cluster group based on the phrases in the first cluster of the cluster group having the particular word, and presents search results based on content that includes phrases in the second cluster of the cluster group.