Cluster-Level Vector Similarity for Large Data Sets

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data management platforms face challenges in efficiently identifying similarities between large and complex user profiles across different data sets due to computational expenses and the need for advanced feature selection and clustering techniques.

Innovation Solution

A cloud-based application executes machine-learning techniques, including predictive feature selection and unsupervised clustering, to detect similar user profiles by transforming features into vectors for cluster-level comparison, enabling efficient similarity determination without prior knowledge of user features.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If user-to-user similarity modeling is performed using a known set of user features, then similarity detection between user profiles can be achieved, but the computational cost becomes excessively high due to the complexity of user profiles

Engineering Contradiction:
Improvesimilarity detection accuracyVSAvoidcomputational efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the user profiles into clusters based on shared characteristics and features. Instead of comparing every user profile against every other user profile (user-to-user), the system groups similar users into clusters and performs similarity detection at the cluster level. This segmentation dramatically reduces the computational complexity while maintaining the ability to identify similar user profiles, as the cluster representations capture the essential similarity patterns.

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If the data sets contain large numbers of user profiles with complex features, then more comprehensive user data can be analyzed, but the processing time and computational resources required increase significantly

Engineering Contradiction:
Improvedata set sizeVSAvoidprocessing time
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The patent creates simplified representations (copies) of user profiles in the form of cluster vectors that capture the essential characteristics of groups of users. Instead of processing the full complexity of individual user profiles with all their features, the system uses these cluster-level vector representations to perform similarity comparisons. This copying approach allows the system to handle large data sets efficiently by working with condensed representations that retain the necessary information for similarity detection.

Inventive Principle:
Principle #26Copying

3Productivity

If feature selection and clustering techniques are implemented to reduce computational complexity, then processing efficiency improves, but the system requires advanced machine-learning capabilities that increase implementation complexity

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidsystem implementation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent performs feature selection and clustering operations in advance to create pre-computed cluster representations and vectors. By performing these computationally intensive operations beforehand (preliminary action), the system prepares the data in a format that enables efficient similarity comparisons later. This preliminary processing reduces the computational burden during actual similarity detection, as the heavy lifting of feature selection and clustering has already been completed, leaving only straightforward vector comparisons.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11449773B2Enhanced similarity detection between data sets with unknown prior features using machine-learning
Publication Date: 2022.09.20 ORACLE INT CORP
  • US11449773B2 patent drawing
  • US11449773B2 patent drawing
  • US11449773B2 patent drawing

AI summary

The present disclosure relates to systems and methods for using machine-learning techniques to detect similar features between data sets. More particularly, the present disclosure relates to systems and methods that learn feature patterns within at least two data sets using machine-learning techniques to determine similarities between clusters of users in a scalable and computationally efficient manner.