Entity Fingerprint Search for Scalable Semantic Retrieval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional systems face challenges in efficiently managing, retrieving, and analyzing large volumes of unstructured data due to scalability, accuracy, and computational inefficiencies, often leading to time-consuming and imprecise results, and the issue of hallucination in language models undermines trust in information retrieval.

Innovation Solution

A knowledge management system that generates compressed binary fingerprints from high-dimensional vector embeddings using statistical measures, enabling fast and scalable comparisons through optimized memory storage and efficient query handling, supported by advanced NLP models and homomorphic encryption for secure data processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional keyword-based search or manual curation is used for unstructured data, then simplicity and ease of implementation are maintained, but retrieval accuracy and efficiency deteriorate significantly

Engineering Contradiction:
Improveretrieval accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces conventional keyword-based mechanical search with a neural network-based semantic embedding system. The system uses language models to generate vector embeddings that capture semantic meaning, enabling accurate retrieval of unstructured data based on meaning rather than exact keyword matches. This substitution resolves the contradiction by achieving high retrieval accuracy through semantic understanding while managing complexity through automated neural network processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transforms the search parameter from discrete keywords to continuous vector embeddings in a high-dimensional space. By representing data and queries as vectors and using similarity metrics (e.g., cosine similarity) to measure semantic proximity, the system achieves accurate retrieval. The parameter change from categorical keywords to continuous semantic vectors enables nuanced matching while the automated embedding process manages the complexity of handling unstructured data.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If language models are used for processing large-scale unstructured data, then semantic understanding and retrieval accuracy improve, but computational cost and processing time increase significantly

Engineering Contradiction:
Improvesemantic understanding accuracyVSAvoidcomputational cost
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies preliminary action by pre-processing unstructured data into semantic embeddings and organizing them in a searchable vector space before queries are submitted. Data is transformed into vector representations and stored with metadata, enabling efficient retrieval without requiring heavy language model computation during query processing. This pre-computation approach reduces real-time computational costs while maintaining high semantic understanding accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the data processing pipeline into distinct stages: data ingestion, embedding generation, vector storage, and query processing. By dividing the workflow, the system can optimize each stage independently—using language models only for embedding generation during data preparation, then relying on efficient vector similarity searches during querying. This segmentation reduces overall computational cost by avoiding repeated heavy model inference while preserving semantic understanding capabilities.

Inventive Principle:
Principle #1Segmentation

3Reliability

If comprehensive processing of massive datasets is performed to ensure accurate retrieval, then retrieval completeness improves, but processing time and system response delay increase

Engineering Contradiction:
Improveretrieval completenessVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies partial action by retrieving a limited number of top-k most relevant results based on similarity scoring rather than processing and returning all matching data. The system ranks embeddings by similarity to the query vector and returns only the highest-ranked results that meet a relevance threshold. This approach ensures retrieval completeness for the most important results while significantly reducing processing time by avoiding exhaustive analysis of entire datasets.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent performs preliminary indexing and organization of data embeddings with associated metadata and similarity metrics before queries are executed. The vector database pre-computes and stores embedding representations, enabling rapid similarity searches during querying. This preliminary preparation ensures that comprehensive retrieval can be performed efficiently by leveraging pre-processed data structures rather than computing similarities from raw data during query processing.

Inventive Principle:
Principle #10Preliminary action

4Measurement precision

If high-dimensional vector embeddings are stored and processed for all data instances, then retrieval accuracy and semantic capability are improved, but memory consumption and storage requirements increase significantly

Engineering Contradiction:
Improveretrieval accuracyVSAvoidmemory consumption
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential semantic features into compact vector embeddings rather than storing complete high-dimensional representations for all data. The system generates embeddings that capture the most important semantic information and stores these compressed representations in a vector database. This extraction approach maintains retrieval accuracy by preserving key semantic relationships while significantly reducing memory consumption compared to storing full-text or complete feature sets.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the parameter representation from high-dimensional continuous vectors to compressed binary fingerprints for storage and comparison. The system transforms vector embeddings into compact binary representations that retain essential similarity information while occupying minimal storage space. This parameter transformation enables efficient storage and rapid comparison of large numbers of data instances while maintaining the ability to perform accurate semantic retrieval through binary similarity metrics.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20260105058A1Compression-Based Data Instance Search
Publication Date: 2026.04.16 PIENOMIAL INC
  • US20260105058A1 patent drawing
  • US20260105058A1 patent drawing
  • US20260105058A1 patent drawing

AI summary

A knowledge management system may receive a set of data instances. The system may extract a plurality of entities from the set of data instances. The system may convert the plurality of entities into a plurality of entity embeddings, each entity embedding representing an entity in a latent space. The system may generate a reference embedding that has the same length as the plurality of entity embeddings. The system may compare, for each value in each entity embedding, the value to a corresponding value of the reference embedding. The system may generate a plurality of entity fingerprints, each entity fingerprint corresponding to an entity embedding, each entity fingerprint comprising Boolean values that are generated based on comparing values in each entity embedding to corresponding values of the reference embedding. The system may store the plurality of entity fingerprints to represent the plurality of entities.