Particle Thompson Sampling for Online Matrix Factorization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional recommendation systems face challenges in providing recommendations for new users and items (cold start problem) and adapting quickly to user feedback in online settings, as they rely on historical data and update only user latent features, not both user and item latent features in real time.

Innovation Solution

The implementation of Particle Thompson Sampling for online matrix factorization, which combines matrix factorization with a bandit algorithm using Thompson Sampling and a Rao-Blackwellized particle filter to update both user and item latent features in real time, enabling quick adaptation to user ratings and recommendations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional matrix factorization techniques are used to provide recommendations, then recommendations can be generated based on historical data, but the system cannot handle new users and items (cold start problem) and cannot adapt quickly to user feedback in online settings

Engineering Contradiction:
Improveability to handle new users and itemsVSAvoidtime to adapt to user feedback
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system pre-generates item recommendations for new users based on item features before the user provides any ratings. This preliminary action allows the system to immediately serve new users without waiting for historical data to accumulate, thereby solving the cold start problem and enabling quick adaptation to online settings

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The recommendation system dynamically updates recommendations in real-time as new user feedback arrives. The system transitions from static offline batch processing to dynamic online incremental learning, allowing it to continuously adapt to new users and items without requiring complete retraining, thus reducing adaptation time

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If conventional recommendation systems analyze ratings data offline, then comprehensive analysis can be performed, but the system cannot quickly adapt to user feedback in real-time online settings

Engineering Contradiction:
Improveaccuracy of ratings analysisVSAvoidspeed of adaptation to user feedback
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

Item recommendations are pre-computed based on item features before online interaction begins. This preliminary computation allows the system to maintain high analysis quality while enabling fast real-time recommendations without requiring complete offline reprocessing

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous learning by incrementally updating recommendations as new user feedback arrives in real-time. This continuous useful action ensures both high measurement precision through comprehensive analysis and fast speed through incremental updates rather than periodic batch processing

Inventive Principle:
Principle #20Continuity of useful action

3Device complexity

If conventional systems update only user latent features, then the update process is simpler, but the system cannot provide timely and personalized recommendations in online settings

Engineering Contradiction:
Improvecomplexity of update processVSAvoidtimeliness of recommendations
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

Item recommendations are pre-generated based on item features before online interaction. This preliminary action reduces the complexity of real-time updates while improving productivity by enabling immediate recommendations without complex iterative optimization

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system extracts and updates only the necessary components (user latent features and item recommendations) in real-time while keeping other components fixed. This selective extraction reduces update complexity while maintaining timeliness of recommendations in online settings

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10332015B2Particle thompson sampling for online matrix factorization recommendation
Publication Date: 2019.06.25 ADOBE INC
  • US10332015B2 patent drawing
  • US10332015B2 patent drawing
  • US10332015B2 patent drawing

AI summary

Particle Thompson Sampling for online matrix factorization recommendation is described. In one or more implementations, a recommendation system provides a recommendation of an item to a user using Thompson Sampling. The recommendation system then receives a rating of the item from the user. Unlike conventional solutions which only update the user latent features, the recommendation system updates both user latent features and item latent features in a matrix factorization model based on the rating of the item. The updating is performed in real time which enables the recommendation system to quickly adapt to the user ratings to provide new recommendations. In one or more implementations, to update the user latent features and the item latent features in the matrix factorization model, the recommendation system utilizes a Rao-Blackwellized particle filter for online matrix factorization.