Item Recommendation Techniques Using Rank-Constrained Matrix Factorization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing collaborative filtering techniques fail to provide relevant and efficient recommendations in large-scale environments where only positive interest feedback is available, as they struggle to identify user interests accurately due to the absence of negative feedback data.

Innovation Solution

The techniques employ a rank-constrained formulation to determine a similarity matrix by modeling it as the product of two smaller matrices, using positive interest information to quantify similarities between items and users, and apply a randomized SVD technique to make computations feasible in large-scale environments with millions of users and items.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If existing collaborative filtering techniques are used to identify recommended items, then recommendations can be provided to users, but the techniques are unable to provide adequate recommendations in large-scale environments with only positive interest feedback

Engineering Contradiction:
Improverecommendation relevancyVSAvoidapplicability to large-scale positive feedback environments
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent changes the fundamental parameters of the collaborative filtering approach by using rank-constrained matrix factorization instead of traditional methods. It models the rating matrix R as a product of two lower-rank matrices (user-factor matrix P and item-factor matrix Q), where the rank k is constrained to be much smaller than the dimensions of the original matrices. This parameter transformation enables the system to handle large-scale data efficiently while maintaining recommendation quality in positive feedback-only environments.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the mechanical computation approach of traditional collaborative filtering with an algebraic matrix factorization approach. Instead of directly computing similarities between users or items in the original high-dimensional space, the system substitutes this with matrix decomposition operations that operate in a lower-dimensional latent factor space, making the computation feasible for large-scale datasets.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Quantity of substance

If traditional collaborative filtering methods are applied to large datasets with millions of users and items, then comprehensive coverage is achieved, but computational efficiency deteriorates significantly

Engineering Contradiction:
Improvescale of users and itemsVSAvoidcomputational efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent applies dimensionality reduction by transforming the problem from the original high-dimensional user-item interaction space to a lower-dimensional latent factor space. By factorizing the rating matrix into two matrices of rank k (where k << min(m,n)), the system reduces the computational complexity from O(mn) to O(k(m+n)), enabling efficient processing of large-scale datasets with millions of users and items while maintaining comprehensive coverage.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent segments the large rating matrix R into two smaller matrices P and Q through factorization. This segmentation allows the system to process and store data more efficiently by working with the factor matrices separately rather than maintaining the full dense rating matrix, thus improving computational efficiency while handling large quantities of users and items.

Inventive Principle:
Principle #1Segmentation

3Loss of information

If the similarity matrix is determined without rank constraints, then complete relationships between users and items are captured, but the computational complexity and storage requirements increase significantly

Engineering Contradiction:
Improvecompleteness of user-item relationshipsVSAvoidcomputational and storage complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces a rank constraint parameter k that controls the complexity of the factor matrices. By setting k to a value much smaller than the dimensions of the original matrices, the system achieves a balance between capturing essential user-item relationships and reducing computational and storage complexity. The constraint rank(P) ≤ k and rank(Q) ≤ k ensures that the factorization remains manageable while preserving the most significant patterns in the data.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11354720B2Item recommendation techniques
Publication Date: 2022.06.07 ADOBE INC
  • US11354720B2 patent drawing
  • US11354720B2 patent drawing
  • US11354720B2 patent drawing

AI summary

Techniques disclosed herein provide more efficient and more relevant item recommendations to users in large-scale environments in which only positive interest information is known. The techniques use a rank-constrained formulation that generalizes relationships based on known user interests in items and/or use a randomized singular value decomposition (SVD) approximation technique to solve the formulation to identify items of interest to users in an efficiently, scalable manner.